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This  thesis  uses  this  System  Dynamic  Model's  gaming  interface  to  investigate  the 
effects  of  time  delays  on  software  project  management.  Specifically,  this  experiment 
focuses  on  how  software  project  managers  compensate  for  assimilation  and  hiring  delays 
inherent  to  a  single  project  environment.  The  effect  of  these  delays  are  measured  in  terms 
of  staffing  level  decisions,  final  cost,  and  project  completion. 


in 


37251? 
U 


TABLE  OF  CONTENTS 

I.  INTRODUCTION 1 

A  BACKGROUND 1 

B  PURPOSE  OF  RESEARCH 2 

C  SCOPE  OF  RESEARCH 3 

D         LIMITATIONS 3 

E  THESIS  ORGANIZATION 4 

II  PREPARATION  OF  THE  GAME  INTERFACE 5 

A.         EXPERIMENTAL  DESIGN 5 

B  THE  SOFTWARE 8 

1 .  Software  Interface 8 

2.  Software  Instructions 12 

C  THE  DOCUMENTATION 15 

D  TRIAL  EXPERIMENT 17 

E  FINAL  PREPARATIONS 19 

III.        CONDUCTING  THE  EXPERIMENT 21 

A  TASKS  AND  PROJECT  CHARACTERISTICS 21 

B  ORGANIZING  THE  EXPERIMENT 21 

C  THE  EXPERIMENTAL  SUBJECTS 22 

D  DEPENDENT  MEASURES 23 

IV        EXPERIMENTAL  RESULTS  AND  ANALYSIS 25 


IV 


DUDLEY  KNOX  LIBRARY 

NAVAL  POSTGRADUATE  SCHOOL 

MONTEREY  CA   93943-5101 


A  MODEL  OF  ANALYSIS 25 

B.         RESULTS 26 

1.  Staffing  Level  Decisions 26 

2.  Deviation  of  Staff  levels  from  Optimum 28 

3.  Percentage  deviation  of  Staff  from  Optimum 30 

V         CONCLUSIONS 33 

A  FINDINGS  AND  IMPLICATIONS 33 

B  FURTHER  RESEARCH 33 

APPENDIX  A:    DYNEX  PROGRAM  FLUE  (PROJECT?  DNX) 35 

APPENDIX  B:    BATCH  CONTROL  FILE  (PROJECT*?. BAT) 39 

APPENDIX  C:    BATCH  CONTROL  FILE  (TEST  BAT) 42 

APPENDIX  D:   "PROJECT'?"  EXPERIMENT  DOCUMENTATION 45 

APPENDIX  E:   "PROJECTA"  DOCUMENTATION  SET 47 

APPENDIX  F:  "PROJECTB"  DOCUMENTATION  SET 49 


APPENDIX  G:  "PROJECTC"  DOCUMENTATION  SET 51 


APPENDIX  H:  "PROJECTD"  DOCUMENTATION  SET 53 


APPENDIX  I:    SAMPLE  POPULATION  RANDOMIZING  WORKSHEET     55 


APPENDIX  J:    SEATING  CHARTS 57 


APPENDIX  K:    STAFFING  LEVEL  DECISIONS  WORKSHEET 59 


APPENDIX  L    SAS  DEMOGRAPHIC  CONTROL  FILE 60 


APPENDIX  M:   SAS  GLM  AND  RPT  MEAS  CONTROL  FILE 61 


APPENDIX  N:   SAS  DEMOGRAPHIC  FILE 64 


APPENDIX  O:  SAS  DATA  FILE 65 


LIST  OF  REFERENCES 70 


INITIAL  DISTRIBUTION  LIST 71 


VI 


I.     INTRODUCTION 

A.    BACKGROUND 

Within  the  Department  of  Defense  (DOD),  as  well  as  many  other  Federal  service 

agencies,  a  critical  problem  exists  concerning  software  development  and  management. 
Software  projects  that  are  over  budget  and  behind  schedule  are  commonplace  and  it  seems 
conceivable  that  this  trend  will  continue  if  we  do  not  determine  the  causes  and  strive  to 
resolve  them.  Managers  of  these  projects  are  continuously  blamed  for  the  failure,  but 
seldom  given  direction  to  correct  the  situation. 

Two  of  the  most  crucial  project  components  the  project  manager  is  concerned  with 
are  people  and  money.  The  various  idiosyncrasies  of  people  and  the  constant  flux  in 
project  budgets  cause  difficult  problems  for  the  manager  who  always  needs  more  people 
than  his  money  can  buy. 

What  then  can  we  do  to  help  these  managers  come  to  grips  with  this  problem7 
One  focus  is  to  break  apart  the  various  decision  areas  the  manager  is  involved  with  and 
analyze  the  various  options.  Through  this  evaluation,  perhaps  we  might  isolate  and  better 
understand  each  area  and  provide  managers  with  the  proper  direction  they  should  follow 
or  at  least  clear  up  the  gray  areas  to  clarify  their  role. 

A  comprehensive  simulation  model  that  addresses  the  dynamics  of  software 
development  has  been  developed  at  the  Naval  Postgraduate  School  [Ref  1  ]  and  provides  a 
platform  for  experimentation.  This  Systems  Dynamics  Model  (SDM)  allows  the 
manipulation  of  one  or  several  factors  while  holding  others  constant  so  we  may  study  the 


decision  making  process  in  segments.  Through  the  simulation  of  software  project 
management  scenarios,  we  are  able  to  isolate  several  decision  processes  concerning 
scheduling,  staffing  and  productivity.  These  results  then  can  be  analyzed  to  see  what 
impact  the  decisions  had  on  the  project. 

One  area  of  research  to  be  studied  is  that  of  staffing  decisions.  Project  managers 
are  continuously  faced  with  difficult  manning  decisions  that  seriously  affect  the  project's 
schedule  and  budget.  Within  this  staffing  area,  managers  are  faced  with  delays  in  hiring 
and  assimilating  personnel  into  the  project  and  often  make  the  decision  to  hire  late  in  the 
life  cycle  to  bring  the  project  to  a  successful  completion.  The  problem  of  such  late  hiring 
has  been  stated  clearly  in  Brooks  Law.  "Adding  people  to  a  late  project  makes  it  later" 
[Ref  1], 

Through  the  analysis  of  various  management  scenarios  we  can  focus  on  what 
information  managers  use  to  make  different  staffing  decisions.  By  comparing  projects  with 
different  time  delay  periods  we  can  better  understand  where  the  decision  process 
concerning  late  staffing  gets  derailed. 

B.         PURPOSE  OF  RESEARCH 

The  purpose  of  this  thesis  is  to  design,  develop,  and  then  execute  an  experiment 

using  a  single  project  management  environment  using  the  Systems  Dynamic  Model  (SDM) 
gaming  interface.  The  objective  of  the  experiment  is  to  examine  the  effects  of  assimilation 
and  hiring  delays  on  managerial  staffing  decisions.  Even  though  research  has  been 
conducted  into  the  affects  of  delays  on  decision  making  [Ref.   2]  ,  no  study  on  the  effects 


of  delays  on  staffing  software  projects  using  this  type  of  tool  has  been  performed  and 
analyzed. 

C.  SCOPE  OF  RESEARCH 

The  scope  of  this  research  is  the  design,  construction,  and  execution  of  the  systems 

dynamic  model/gaming  interface  using  a  single  project  environment  that  has  been 
specifically  designed  to  isolate  the  staffing  variable.  A  group  of  experimental  subjects  was 
divided  into  four  groups  (A-D)  working  on  the  exact  same  simulated  project.  The  only 
differences  among  the  groups  were  varying  assimilation  and  hiring  delay  time  periods  that 
was  described  in  the  documentation  provided  to  each  group.  Great  care  was  taken  to 
insure  that  each  of  the  four  tested  groups  were  administered  the  exact  same  project  to 
manage,  and  to  insure  that  each  participant  had  no  idea  of  what  the  other  participants  were 
working  on. 

D.  LIMITATIONS 

The    participants  studied  for  this  experiment  were  graduate  students  in  their  fifth 

quarter  of  an  eight  quarter  preparation,  graduate  and  subspecialty  education  program 
leading  to  a  MS  degree  in  Information  Technology  Management  at  the  Naval  Postgraduate 
School  in  Monterey,  California.  Although  these  students  were  not  in  fact  software  project 
managers,  the  amount  of  education  in  software  project  management  and  related  subjects 
provided  thus  far  in  their  curriculum,  coupled  with  general  management  experience  in  their 
careers,  suggests  that  they  are  appropriate  surrogates  for  real  life  software  managers.  This 


is  further  supported  by  findings  of  Williams  Remus  in  his  research  of  using  graduate 
students  for  experimental  studies  [Ref.  3]. 

E.         THESIS  ORGANIZATION 

Chapter   II      is   an   in-depth   description   of  the   experiment's   organization,    its 

methodology,  and  experimental  group.  Chapter  III  describes  the  various  software  files 
and  the  design  of  the  documentation,  as  well  as  the  construction  considerations  taken  into 
account  during  the  creation  of  the  experiment  The  chapter  also  covers  the  trial  experiment 
and  outcomes.  Chapter  IV  analyzes  the  results  and  validates  the  findings.  Chapter  V  is  a 
summery  of  the  prominent  accomplishments  and  findings  presented  in  chapters  II-IV  as 
well  as  suggestions  for  further  research. 


II.         PREPARATION  OF  GAME  INTERFACE 
A.         EXPERIMENTAL  DESIGN 

Just  like  a  flight  simulator  aids  a  pilot  in  simulating  flight  environments,  the 
Systems  Dynamic  Model  (SDM)  aids  in  simulating  the  life  of  a  real  software  project  for 
software  project  managers.  The  model  simulates  a  software  development  project 
environment  beginning  with  the  "Design"  phase  and  ending  with  the  completion  of  the 
"Testing"  phase. 

For  this  experiment,  a  single  research  question  was  isolated  for  examination:  Do 
software  project  managers  compensate  for  hiring  delays  and/or  assimilation  delays  in  their 
staffing  decisions9  The  experiment  focuses  on  how  managers  handle  the  hiring  and 
assimilation  delays  inherent  to  their  particular  projects,  and  how  the  decisions  they  make 
concerning  these  delays  are  reflected  in  their  staffing  decisions. 

In  the  experiment,  participants  assume  the  role  of  software  project  managers. 
They  are  tasked  to  use  information,  gleaned  from  reports  generated  by  the  model  every 
two  calendar  months  (forty  working  days),  in  conjunction  with  their  knowledge  of  the 
hiring  and  assimilation  delays  inherent  to  their  project,  to  update  the  project's  staffing 
level  They  can  either:  1)  increase  the  staff  level,  essentially  hiring  personnel;  or  2) 
decrease  the  staff  level,  essentially  firing  personnel;  or  3)  do  neither  by  maintaining  their 
current  staff  level.  The  overall  goal  for  each  manager  is  to  complete  the  project  on 
schedule  and  within  budget.    A  sample  report  is  illustrated  in  Figure  2- 1 . 


CURRENT  INTERVAL  STATISTICS:      Elapsed  Time  =    40 
INITIAL  ESTIMATES.  (These  will  not  change  throughout  the  project) 
Project  Size  397    Tasks 

Project  Cost  1,111    Person-Days 

Project  Duration  320     Days 


REPORTED  STATISTICS  at  Time 

Updated  Estimate  of  Total  Project  Size 

%  Development  Reported  Complete 

Total  Person  Days  Expended  to-date 

New  Est  of  Project  Duration  (start-end) 

Time  Remaining 

Current  Staff  Size 

Percent  of  Workforce  that  is  Experienced 

PRESS  <ENTER>  TO  VIEW  THE  GRAPHICALLY  DISPLAYED  VARIABLES 


> 

40  Days 

0 

Tasks 

45 

Percent 

684 

Person  Days 

285 

Days 

280 

Days 

5.00 

People 

70 

Percent 

Figure  2-1  Sample  report,  generated  every  40  working  days 

To  compare  the  varying  managerial  decisions,     each  participant  was  assigned 

randomly  to  one  of  four  groups  (A-D).     Each  group  was  in  turn  assigned  different 

assimilation  and  hiring  delays.  Figure  2-2  illustrates  these  delays. 
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Figure  2-2  Assimilation  and  Hiring  delay  differences  by  Group 


The  actual  names  assigned  for  this  experiment  were:  Projecta,  Projectb,  Projectc,  and 
Projectd  As  illustrated  in  figure  2-2,  Group  A  was  assigned  maximum  assimilation  and 
hiring  delays  (80  days  for  assimilation,  60  days  for  hiring),  group  B  maximum  assimilation 
delay  only  (80  days  for  assimilation,  12  days  for  hiring),  group  C  maximum  hiring  delays 
only  (9  days  for  assimilation,  60  days  for  hiring),  and  Group  D  minimal  hiring  and 
assimilation  delays  (9  days  for  assimilation,  12  days  for  hiring). 

Throughout  this  chapter,  the  symbol  ?  will  be  used  to  identify  generic  file  reference 
to  the  four  projects,  (i.e.  Project7.BAT).  This  experiment  was  created  using  data 
collected  from  a  real  NASA  project  This  is  advantageous  in  that  it  allows  for 
measurement  and  comparison  against  a  known  baseline. 

Each  participant  was  provided  a  folder  with  documentation  pertaining  to  his/her 
randomly  assigned  group  and  a  disk  containing  the  group's  software  The  independent 
variables  were  the  hiring  and  assimilation  delays  described  in  the  documentation  provided 
within  each  folder  The  dependent  variables  were  the  staff  level,  project  cost,  and 
completion  time.  These  folders  are  discussed  later  in  the  chapter  as  well 

All  participants  had  prior  experience  with  the  SDM  interface  in  a  previous  course 
in  a  slightly  different  context.  To  ensure  that  they  were  comfortable  with  the  simulation,  a 
sample  report  was  provided  along  with  a  30  minute  review  of  project  management  The 
participants  were  also  told  that  a  "TEST"  run  would  be  accomplished  by  each  participant 
just    prior   to   the    actual    simulation.       This      simulation,    called    "TEST",    and    it's 


documentation,  mirrored  the  experiment  simulation  with  the  exception  of  the  default  staff 
level  and  project  duration. 

Participants  were  not  paid  monetarily,  but  were  told  that  they  would  be  assigned  a 
grade  based  on  their  performance.  This  was  to  insure  that  they  would  be  serious  and 
diligent  in  their  participation.  Disclosure  of  experiment  specifics  was  held  until  the  day  of 
the  experiment  so  as  to  better  control  the  knowledge  base  of  the  participants. 

B.         THE  SOFTWARE 

There  were  two  primary  efforts  in  the  design  of  the  experiment's  software;  the 

software  interface,  and  the  instructions  for  its  use.  Much  care  was  taken  to  ensure  the 
interface  was  both  easy  to  use  and  clear  in  it's  purpose  For  each  screen,  detailed  written 
and  on  screen  documentation  was  provided  to  ensure  total  comprehension  of  the 
environment.  The  purpose  of  this  was  to  ensure  that  the  participants  were  capable  of 
using  the  interface  without  having  to  worry  about  how  the  simulation  works 

1.  Software  Interface 

The  SDM  software  includes  the  DYN  simulator  as  well  as  DYNEX  files  which 
help  model  the     interface.  The  DYNEX  file,  Proj9.DNX,  provides  three  primary 

functions:  1)  it  displays  information  on  the  screen  to  the  participant;  2)  it  captures  the  staff 
variable  input;  and  3)  it  provides  an  output  format  for  the  simulations  reports.  A  copy 
of  the  DYNEX  file  is  provided  in  appendix  A. 

The  DYNEX  file  works  directly  with  the  Project9. BAT  batch  file  This  batch  file 
is  the  primary  control  file  for    the  entire  user  interface,  and  is  common  to  each  group 


project.     This  file  directs  a  basic  set  of  files  that  inter-operate  and  control  the  whole 
simulation     Figure  2-3  illustrates  the  overall  architecture. 
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Figure  2-3  Flowchart  of  basic  set  of  project  files 

The  Project7.BAT    invokes  the  interface,  prompts  the  DYNEX  file  to  provide 

instructions  during  each  simulation,  and  controls  the  display  of  the  status  reports  as  well  as 

the  initiation  of  the  next  set  of  inputs.   A  copy  of  this  batch  file  is  provided  in  appendix  B 

Paramount  to  the  design  process  was  the  ability  to  capture  data  to  files  for  later 

analysis   This  was  done  using  various  OUT  files  each  feeding  or  storing  information  as 

needed.    These  OUT  files  greatly  enhanced  later  analysis  in  that  they  worked  collectively 

to  capture  critical  variable  data,  especially  the  staff  level  (WFS),  input  by  the  participant 

into  a  cumulative  file  called  INFO  for  each  participant.  Figure  2-4  illustrates  the  INFO  file 

for  one  participant.  These  INFO  files  were  later  combined  for  all  participants  for  analysis 

As  illustrated  in  this  figure,  eighteen  variables  were  captured  using  the  various  OUT  files 

and  input  into  appropriate  columns.   The  numerical  data  in  this  figure  was  excerpted  from 


a  single  participants  file,  however,  the  column  names  were  added  to  identify  each  variable 
captured  Definitions  of  these  variables  can  be  found  in  the  variable  initialization  portion 
of  the  SAS  Control  file  in  appendix  M. 
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Figure  2-4  Sample  of  single  participants  INFO  file  with  added  identifiers 

Furthermore,  timestamp  and  capture  files  were  included  in  the  simulation  to 

capture   the   time    passage   during   each   of  the   participants   decision    intervals.    This 

TIMESTMP  feature  was  transparent  to  the  participant  as  they    had  no  idea  they  were 

being  timed  on  their  decisions.      Figure  2-5  shows  these  files  as  they  are  encountered 

within  the  Project9  BAT  file    This  feature  works  in  the  following  sequence:   at  the  start  of 

the  decision  cycle,  when  the  report,  shown  in  figure  2-1,  is  viewed  by  the  participant,  the 

TIMESTMP  file  copies  the  computer  clock  time  to  a  temporary  file;  when  the  participant 

completes  the  interval,  the  Project9. BAT  file  loops  back  to  the  beginning  of  the  reporting 

sequence  (-top)  and  updates  the  simulation  files  with  the  new  staff  level;  the  CAPTURE 

file  then  takes  the  current  clock  time,  compares  it  to  the  temporarily  stored  TIMESTMP 

time,  and  annotates  the  difference,  in  seconds,  to  the  INFO  file  under  the  column  TIME 
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Figure  2-5  illustrates  the  proper  placement  of  these  two  files  within  the  Project7. BAT  file 
Since  the  placement  of  the  CAPTURE  file  needed  to  come  before  the  looped  TIMESTMP 
file,  an  initial  TIMESTMP  was  placed  before  the  CAPTURE  file,  outside  the  loop,  to  feed 
it  a  time,  thus  this  time  period  has  no  bearing  in  the  analysis.  The  entire    BAT  file  can  be 
viewed  in  appendix  B. 


echo  off 

CLS 

init  1 

GRAPHICS 

bat  /N  /p  /s 

smlt  PROJA  -go  =  -prs  =  -Is  -ns  -plm  6  -bw 
rep  PROJA  INTRVAL  -outf  INTRVAL  OUT  -t  -bw  >NUL 
rep  PROJA  INTRVAL  -outf  INTRVL.  OUT  -bw  >NUL 
rep  PROJA  -t  -bw  >NUL 
timestmp 

-top     dynex  PROJA  -in  PROJA.  STT  -sc  -Is  -plm  6  -bw 
smlt  PROJA  -gm  =  -ns  -plm  6  -bw 
capture 

rep  PROJA  INTRVAL  -outf  INTRVAL  OUT  -t  -bw  >NUL 
rep  PROJA  INTRVAL  -outf  INTRVL. OUT  -bw  >NUL 
rep  PROJA  -bw  >NUL 
call  -topi 
Exit 
goto  -top%A 

-topi   timestmp 
%A  =  1 
ram 
els 


Figure  2-5  Excerpt  form  Project7.BAT  file  showing  timestmp  feature 

This  time  data  allowed  the  designer  to  analyze  decisions  made  over  time  both, 
within  and  between  groups.  This  information  is  presented  later  in  chapter  IV. 

In  all,    27  files,  including  the  base  set  illustrated  in  figure  2-3,    were  needed  to 
conduct  the  experiment.  Figure  2-6  lists  these  necessary  files. 


PROJECT0  BAT  -  Directly  controls  user  interface 

TEST  BAT  -  Directly  controls  user  interface  for  test  portion 

INIT  EXE  -  Asks  for  student  name  and  SMC  box  for  identification 

BAT  COM  -  Controls  BAT  files  within  simulation 

DYNEX  EXE  -  Allows  execution  of  DYNEX  files 

SMLT.EXE  -  Primary  DYNAMO  execution  file 

REP  EXE  -  Generates  specified  report  formats 

INFOOB.EXE  -  Strips  data  from  numerical  screen  inputs 

INFO  -  Collects  all  report  data  stripped  from  INFOOB.EXE 

JUNK  OUT  -  Feeds  last  report  screen  output  to  INFOOB.EXE 

INTERVAL  OUT  -  Contains  copv  of  last  output  screen 

INTER VL  DRS  -  Screen  report  format 

PROJ9  CHG  -  DYNAMO  generated  file 

PROJ9  DAT-  DYNAMO  required  file 

PROJ9  DNX  -  Project  specific  DYNEX  file 

PROJ9  DRS  -  Project  report  file 

PROJ9  DYN  -  Project  DYNAMO  file 

PROJ9  INS    -  DYNAMO  required  simulation  file 

PROJ9  OUT  -  Captures  project  inputs  from  user 

PROJ7.RSL  -  DYNAMO  generated  file 

PROJ9  SMT  -  DYNAMO  required  simulation  file 

PROJ9  WAS  -  Temp  storage  for  input  variables 

PROJ9  STT  -  DYNAMO  generated  file 

PROFXPL9  DRS  -  Determines  variables  to  be  plotted 

TIME  TMP  -  Stores  timing  data  generated  by  timestmp.exe 

TIMESTMP  EXE  -  Inserts  decision  timing  data  from  computers  clock 

CAPTURE  EXE  -  Captures  timing  data  for  participant 


Figure  2-6  Project  related  files 

Though  many  variables  came  into  play  for  this  experiment,  four  primary  variables 
were  displayed  to  the  participants  in  the  reports  and  graphs  generated  by  the  simulation 
model  These  were:  (WFS)  -  the  staff  level  requested  by  the  participant;  (FTEQWF) - 
the  full  time  equivalent  staff  level;  (FRWFEX)  -  the  percent  of  the  staff  work  force 
currently  working  on  the  project  that  are  fully  experienced;  And  lastly,  (CMTRMD)  -  the 
cumulative  person-days  spent  by  experienced  staff  training  the  new  staff 

2.  Software  Instructions 

To  aid  the  participants  in  using  the  software,   on  screen  documentation  was 
provided  as  displayed  in  Figure  2-7 
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*************************************** 

! ! ! !  Important  Points  to  Remember  ! ! ! ! 

************************************** 

-  You  are  not  allowed  to  discuss  this  exercise  with  anyone 
other  than  a  lab  attendant.  Please  refrain  from  discussing 
this  with  members  in  the  other  class  until  they  have  completed 
the  exercise. 

-  The  system  will  show  you  the  size  of  the  initial  core  team  of 
software  developers  (the  full  time  equivalent  number).  It  will 
then  ask  you  for  your  initial  desired  staffing  level.  Next  it 
will  run  through  the  first  simulation  time  period  and  show  you 
the  current  reported  statistics.  Make  your  change  to  the 
desired  full  time  equivalent  staffing  level  on  the  documentation 
sheet  provided  after  reviewing  the  report.  There  is  no  need  to 
turn  in  the  documentation  sheet  after  each  interval. 

A  LAB  ATTENDANT  MUST  VERIFY  YOUR  FINAL  RESULTS! 

-  GOOD  LUCK!  Press  <ENTER>  to  continue. 


Figure  2-7  Initial  screen  seen  by  participant 

Following  this  introduction  screen,  the  participant  is  shown  the  initial  staffing  screen  as 

displayed  in  Figure  2-8. 


THE  INITIAL  CORE  TEAM  OF  SOFTWARE 
DEVELOPERS  HAS  BEEN  SET  AT 

3 . 5     Full  time  equivalent  Personnel 

1)  Press  <ENTER>  to  keep  that  same  3.5  full  time  equivalent  staff. 

OR 
2)  Enter  your  initial  desired  staffing  level  and  press  <ENTER> 

[Remember,  you  are  working  in  full  time  equivalent  personnel  ] 


Figure  2-8  Initial  staffing  screen  as  viewed  by  participant 

This  screen  is  the  first  time  the  participant  is  shown  the  initial  staff  size  as  provided  by  the 

software. 

As  a  follow  on  to  the  report,  and  as  indicated  at  the  bottom  of  the  report  screen 
in  figure  2-1,  a  graphic     display  immediately  followed  the  report  plotting  the  report 
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information  This  was  a  hardwired  feature  that  intentionally  could  not  be  bypassed  Figure 
2-9  illustrates  the  four  graphically  plotted  variables  that  were  displayed  on  the  screen  and 
in  the  documentation  to  aid  the  participants  better  understand  what  is  being  displayed 


GRAPHICALLY  DISPLAYED  VARIABLES 
THE  FOLLOWING  VARIABLES  WILL  BE  PLOTTED: 

WFS     STAFF  LEVEL  YOU  REQUESTED 

FTEQWF CURRENT  STAFF  LEVEL 

FRWFEX PERCENT  OF  STAFF  THAT  IS  EXPERIENCED 

CMTRMD  CUMULATIVE  PERSON-DAYS  SPENT  ON 

TRAINING  NEW  STAFF 

AFTER  VIEWING  PLOT  PRESS  <ESC>  TO  CONTINUE 

PRESS  <ENTER>  TO  VIEW  PLOT 


Figure  2-9  Plot  variable  information  as  viewed  by  participant 

After  viewing  the  graph,  the  participant,  through  use  of  a  short  menu  screen,  was 
given  two  options:  1)  review  the  report  and  graph  again;  or  2)  move  to  the  next  interval. 
The  purpose  here  was  to  insure  the  participant  had  full  access  to  the  information  to  make 
decisions  prior  to  moving  to  the  next  interval. 

The  graph  is  displayed  for  the  participant  following  this  screen  The  graph  is 
depicted  with  the  Y-axis  displaying  the  numeric  variable  levels  as  shown  in  the  report,  and 
the  X-axis  depicting  time  in  forty  day  intervals  that  appear  incrementally  following  each 
successive  interval.  Numeric  upper  limits  were  carefully  tested  to  insure  plot  information 
could  be  calculated  given  unusual  staff  level  input 
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C.         THE  DOCUMENTATION 

Creating  the  written  documentation  for  this  experiment  was  an  important  part  in 

ensuring  the  experiment's  success.  In  order  to  eliminate  any  external  bias  in  the 
experiment,  it  was  imperative  that  the  computer  interface  be  maintained  exactly  the  same 
for  all  groups.  This  resulted  in  the  documentation  being  the  only  means  for  conveying  the 
unique  delay  information  to  the  participant  With  this  in  mind,  two  primary  areas  were 
addressed. 

The  first  area  provided  clear  and  extremely  detailed  procedures  for  the  participant 
to  follow  in  setting  up  and  conducting  the  experiment.  These  procedures  fell  into  three 
categories:  1)  how  to  insert  the  disk  and  boot  the  experiment  up;  2)  how  to  initiate  the 
TRIAL  (TEST)  run,  this  area  also  described  in  detail  what  each  sequential  screen  was 
asking  and/or  displaying,  and  how  to  input  the  proper  response  or  decision  for  that 
screen;  and  3)  how  to  run  the  actual  experiment  itself,  this  area  included  a  description  of 
indicators  that  would  be  encountered  when  the  simulation  was  nearing  completion  A 
copy  of  this  documentation  is  contained  in  appendix  D. 

The  second  area  concerning  the  documentation  was  the  most  critical  in  that  this 
was  where  the  delays  were  described  to  the  participants.  Though  the  purpose  of  the 
experiment,  as  far  as  the  participant  was  concerned,  was  to  complete  the  project  on  time 
and  on  budget,  the  actual  experiment  itself  rested  solely  on  the  way  they  handled  the 
information  about  the  delays  described  within  their  documentation.  Copies  of  the  project 
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specific    sets    are    contained    in    appendices    E    through    H.       Figure    2-10    shows    a 
documentation  excerpt. 


SOME  IMPORTANT  THINGS  TO  CONSIDER  IN  MAKING  YOUR  ESTIMATES: 

Your  primary  task  is  to  update  the  project's  staffing  level.  Every 
two-month(40  working  days)  reporting  period,  you  will  have  the  option  to 
adjust  the  Project's  staff  level.  You  may  find  however,  that  the  actual  staff 
level  in  the  status  report  is  somewhat  different  from  the  staff  level  you 
chose    This  will  be  due  to  things  you  cannot  totally  control  such  as  delays  in 
hiring. 

Because  all  personnel  in  the  organization  are  already  assigned  to  other 
projects,  any  staff  additions  you  request  will  be  hired  from  the  outside.  As  a 
result,  there  will  be  a  delay  in  hiring  new  staff  and  in  assimilating  them  into 
your  project. 

-  The  hiring  delay  will  be  3  months  (i.e.,  60  working-days)  on  average. 

-  The  assimilation  delay  for  a  newly  hired  employee  is  typically  4  months 
(i.e.,  80  working-days).  This  is  the  time  it  typically  takes  to  train  a  new 
employee  in  the  mechanics  of  the  project  and  bnng  him/her  up  to  speed 
Because  the  organization  does  not  have  a  formal  training  program,  the 
training  is  done  on  the  job  by  having  one  of  the  experienced  staff  members 
spend  25%  of  his/her  time  "hand-holding"  the  new  employee.  During  this  4 
month  training  period,  a  new  employee  is  typically  only  half  as  productive  as 
an  experienced  employee. 


Figure  2-10  Excerpt  from  Project  A  documentation  concerning  delays 

This  documentation  was  provided  to  ensure  that  the  participants  were  completely 

aware  of  these  delay  periods.    Care  was  taken  to  write  the  documentation  in  such  a  way 

as   to   focus   their   attention   towards   this   information,    and   was   captioned   as   being 

information  important  to  the  experiment. 

Other  related  documentation  contained    information  needed  by  the  participant  to 

be  totally  aware  of  their  responsibilities  and  to  ensure  the  knowledge  each  participant  had 

prior  to  the  simulation  was  equal  concerning  their  respective  groups.    Figure  2-1 1  shows 

this  documentation. 
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PROJECT 

The  project  that  you  will  manage  happens  to  have  been  a  real  project  conducted  in  a  real 
organization.  The  particular  organization  is  on  the  leading  edge  in  software  engineering 
technology.  For  the  project,  you  will  be  given  a  project  profile  containing  the  following 
initial  information: 

Estimated  Project  Size  (in  Number  of  Tasks*) 
Estimated  Project  Cost  (in  Number  of  Person  Days) 
Estimated  Duration  (in  Number  of  Work  Days) 
Size  of  the  Initial  Core  Team  (in  People**) 

*    A  task  is  a  software  module  that  is  approximately  50  lines  of  code  in  size. 
**  The  Core  Team  is  the  group  of  software  professionals  that  developed  the  project's 

requirements'  specifications.  (Remember,  you  are  taking  over  at  the  beginning  of  the 

Design  Phase) 

YOUR  TASK 

Your  objective  in  setting  the  staffing  level  should  be  to  finish  on  schedule 
while  avoiding  a  cost  overrun.  Specifically  you  should: 

a)  complete  the  project  on  schedule. 

b)  at  the  lowest  possible  cost. 

Note:  Finishing  ahead  of  schedule  will  not  gain  you  anything.  In  fact,  it  may  hurt  you, 
since  finishing  ahead  of  schedule  will  probably  mean  hiring  more  staff  than  needed, 
thus  incurring  a  higher  cost  than  required. 


Figure  2-11  Excerpt  form  Project  A  showing  delay  information 

Though  the  data  was  captured  to  OUT  files,  the  designer  thought  it  necessary  to 

maintain    a    Decision    Record    Sheet    to    manually    record    the    staffing    decisions    the 

participants  made  during  the  simulation.    This  allowed  for  backup  of  this  critical  data  as 

well  as  certification  of  the  data  should  the  need  arise     This  record  sheet  is  provided  in 

appendix  K 

D.         TRIAL  EXPERIMENT 

Once  the  gaming  interface  and  documentation  was  complete,  a  trial  experiment 
was  conducted  to  provide  feedback  on  any  problems  that  may  be  encountered  by  the 
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participants  Two  students  were  chosen  to  participate  in  the  trial  experiment  based  on 
their  understanding  of  personal  computers  and  their  abilities  to  properly  critique  this  type 
of  interface  The  objective  of  the  trial  run  was  to  allow  observation  of  the  participants 
interaction  with  the  simulation  environment  and  the  documentation  Based  on  the 
students  participation  in  this  trial  run,  they  were  also  chosen  as  lab  assistants  for  the  actual 
experiment  This  was  advantageous  in  that  they  would  have  prior  insight  into  the 
simulation  environment  and  would  be  able  to  provide  useful  guidance  in  the  absence  of  the 

designer  The  specific  concerns  the  designer  was  attempting  to  examine  were: 

-  Are  the  participants  comfortable  with  the  gaming  environment7 

-  Are  the  instructions  clear9 

-  What  type  of  questions  do  the  lab  assistants  and  the  designer  need  to 
prepare  to  answer  for  the  participants? 

-  How  long  does  the  experiment  take  on  average9 

Following  are  the  majority  of  observations  made  during  the  experiment  trial  run: 


Both  participants  started  the  boot  procedure  without  reading  the  start  up 
documentation.  Since  the  actual  experiment  will  be  conducted  in  a  lab  where  machines 
boot  up  to  a  initial  network  screen,  participants  will  have  to  be  briefed  to  follow 
instructions  explicitly  as  they  may  enter  the  network  inadvertently.  The  two  participants 
were  briefed  to  read  the  instructions  carefully. 

It  was  noted  that  when  viewing  the  plot  following  the  first  interval,  with  no  change 
being  made  to  the  staffing  level,  the  lines  overlapped  each  other  making  it  difficult  to 
comprehend  what  the  plot  was  showing  This  was  later  remedied  by  briefing  the 
participants  that  if  they  choose  not  to  change  the  staff  level  the  first  time  around,  they  will 
see  flat  overlapping  lines  depicting  no  change  for  the  time  period 

One  participant  tried  to  bypass  the  plot  and  found  he  could  not,  he  indicated  that  it 
was  irritating  that  he  could  not  just  review  the  report  without  the  plot. 
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Both  subjects  spent  an  excessive  amount  of  time  on  the  TEST  portion  of  the 
experiment.  This  posed  a  potential  problem  in  that  the  participants  may  try  to  learn  the 
system  too  deeply  prior  to  going  onto  the  experimental  phase  so  as  to  maximize  their 
grade. 

One  participant  asked  if,  when  the  given  staff  level  3.5,  would  entering  4.5  mean 
that  he  had  added  one  person?  The  partial  person  criteria  will  have  to  be  briefed  to  the 
actual  participants  to  ensure  they  are  aware  of  how  the  simulation  model  calculates  the 
staff  level. 

One  participant  noted  that  due  to  the  excruciating  slow  speed  of  operating  off  of 
the  disk  rather  than  the  hard  drive,  the  participants  are  apt  to  begin  to  talk  amongst 
themselves. 

The  participants  took  different  approaches  to  solving  the  staffing  level  One 
calculated  the  level  using  the  established  staffing  equations,  the  other  operated  on  intuition 
alone. 

The    participant  operating    intuitively  finished  after  one  hour    seventeen  minutes 
At  one  hour  forty  five  minutes,  the  remaining  participant  completed  the  project 

E.         FINAL  PREPARATIONS 

Having  completed  the  software  development,  the  written  documentation,  and  the 

incorporation  of  lessons  learned  from     the     trial     experiment,  the  final  preparations 
commenced. 

Individual  folders  were  developed  for  each  participant.  The  documentation  was 
specifically  titled  according  to  the  appropriate  group  (A-D)  and  placed  in  folders  titled  for 
that  particular  group.  Group  disks  were  made  up  and  annotated  with  the  group  letter  and 
taped  into  a  protective  cover  inside  the  folder  Once  a  participant  had  been  randomly 
assigned  to  each  of  the  four  groups,  their  individual  names  were  then  assigned  to  a 
particular  folder  and  disk  for  control  purposes.  This  random  sample  will  be  discussed  in 
chapter  III.    The  experiment  documentation  provided  each  group  was  identical  with  the 
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exception  of  the  specific  group  BAT  file  was  identified  (i.e.  ProjectA.BAT)  for  input  at 
the  prompt  when  initiating  the  actual  experiment  These  were  then  filed  in  their  respective 
folders  Lastly,  a  TEST  and  ACTUAL  experiment  staff  level  record  was  placed  in  each 
folder  along  with  a  pencil  Participants  were  to  arrive  at  the  lab  with  nothing  but  a 
calculator 

Two  laboratories  were  identified  for  use.  These  labs  were  represented  in  a 
computer  drawing  with  each  computer  assigned  to  a  specific  group  so  as  to  separate  the 
participants  within  the  same  group  by  at  least  one  seat.  These  identified  computers  were 
later  assigned  to  specific  participants  who  were  positioned  in  such  a  way  as  to  ensure  that 
no  two  participants  of  the  same  group  label  were  in  eyesight  of  each  others  terminal 
screen  LAB  reservations  were  made  and  signs  posted  to  keep  non-participants  from 
entering  the  lab  during  the  experiment  Lab  assistant  folders  were  created  and  provided 
to  the  lab  assistants.  These  folders  contained  seating  arrangements,  extra  disks  and 
documentation,  pencils,  etc  Also  specific  instructions  were  provided  as  to  what  the 
attendants  could  and  could  not  assist  the  participants  with.  In  the  later  case  they  were 
directed  to  consult  the  designer  before  taking  any  action.  This  added  additional  control  to 
the  experiment  environment. 
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m.       CONDUCTING  THE  EXPERIMENT 

A.  TASKS  AND  PROJECT  CHARACTERISTICS 

After  a  thirty  minute  review  session,  several  days  to  review  and  learn  the  report 
format,  and  having  had  prior  experience  with  the  game  interface,  experiment  participants 
were  now  more  comfortable  with  the  upcoming  experiment.  To  ensure  maximum 
preparation  was  given,  participants  were  briefed  that  the  TEST  simulation  was  scheduled 
to  be  conducted  immediately  preceding  the  actual  experiment. 

The  simulation  was  designed  to  allow  the  participants  to  manage  the  simulation 
independently  Each  participant  was  tasked  to  review  reports  and  plots,  and  then  update 
the  project's  staffing  level  every  two  calendar  month  (40  working  days)  interval  until 
project  completion.  The  participants  used  the  interface  to  input  their  staffing  level 
decision  into  the  model  thus  modifying  the  model  report  output.  The  participants  were 
told  that  their  overall  course  grade  would  be  impacted  by  their  project's  results.  A 
statistical  comparison  of  the  grades  indicated  no  statistical  significance  in  the  means  across 
groups.  (F=  1.12,  d.f.=  3;  P>  0.351) 

B.  ORGANIZING  THE  EXPERIMENT 

The  experimental  introduction  consisted  of  a  thirty  minute  classroom  training 
session  in  which  the  documentation,  seating  arrangements,  and  experimental  guidelines 
were  discussed  This  also  provided  an  opportunity  to  settle  any  last  minute  questions  that 
may  have  been  generated.  The  size  of  the  group  required  that  two  separate  sessions,  both 
requiring  the  use  of  two  labs  simultaneously,  be  provided.   One  lab  assistant  was  assigned 
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to  each  of  the  two  labs  to  provide  the  individual  folders  to  the  participant's  and  to 
provide  general  guidance  to  the  participants  during  the  experiment.  Each  participant  was 
checked  to  ensure  that  their  name  was  assigned  to  the  folder  and  associated  disk  they 
received  before  starting  the  experiment.  The  lab  assistants  were  instructed  to  ensure 
everyone  started  at  the  same  time.  As  illustrated  in  appendix  J,  seating  arrangements 
were  predetermined.  However,  if  machines  were  found  to  be  inoperable,  the  lab  assistants 
were  to  reassign  participants  ensuring  that  no  two  participants  with  the  same  group 
identifier  were  within  screen  view  of  each  other.  Lab  assistants  were  briefed  that  no 
guidance  on  how  to  calculate  the  staffing  levels  or  how  to  interpret  the  reports  was 
allowed.  Each  lab  assistant  had  back-up  disks  and  documentation.  The  experiment  was 
conducted  in  a  single  day. 

All  lab  machines  were  checked  the  day  prior  to  the  experiment.    Lab  reservations 
were  confirmed  and  signs  posted.  A  last  minute  briefing  was  provided  to  the  lab  assistants 
to  ensure  all  matters  were  understood     The  experiment  designer  monitored  both  labs, 
visiting  each  approximately  every  half  hour. 
C.         THE  EXPERIMENTAL  SUBJECTS 

Participants  in  this  experiment  were  gathered  from  two  segments  of  a  Software 
Engineering   and   Management   course,    IS4300,   at   the   Naval   Postgraduate    School 
Segment  one  consisted  of  24  students,  segment  two  had  27  students.     In  order  to 
randomize  the  sample  population  and  assign  them  to  the  four  groups,  the  following 
matched  sample  procedure  was  used  [Ref.  4]. 
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An  alphabetical  list  for  each  segment  was  used  along  with  a  standard  table  of 
random  digits  to  perform  a  two-level  randomization  [Ref  5]  Appendix  I  includes  the 
sample  population  randomizing  worksheet  used  for  each  segment  Column  A  is  the 
alphabetical  listing  of  the  participants  in  each  segment.  Column  B  is  a  two  digit  random 
number,  taken  from  the  standard  table  of  random  numbers  [Ref.  5],  assigned  to  each 
participant  The  row  of  digits  chosen  was  done  randomly  for  each  segment  Once  the 
number  was  assigned,  column  C  was  generated  listing  the  participants  in  numerical 
sequence.  Column  D  then  assigned  the  participants  a  number  from  1  to  4  in  a  stepped 
sequential  fashion  (i.e.  1234,  2341,  3412,  etc.).  The  final  group  randomization  was 
accomplished  by  assigning  the  group  letters  A-D  to  these  numbers  by  randomly  assigning 
a  letter  to  each  number  1  through  4.  In  Column  E,  these  letters  were  then  assigned  to  the 
participant  whose  number  was  correlated  with  it. 

Prior  to  conducting  the  experiment,  all  participants  were  checked  on  the  list  to 
ensure  they  had  received  the  advanced  training  by  matching  their  name  to  an  attendance 
sheet  taken  the  day  of  the  training  session.  It  was  determined  that  two  participants  did  not 
receive  this  training  and  they  were  removed  from  the  experiment.  These  participants  are 
highlighted  on  the  list  in  appendix  I. 
D.         DEPENDENT  MEASURES 

There  are  three  dependent  variables.  Information  contained  in  this  section  can  be 
referenced  against  figure  2-1  in  chapter  II.  The  first  of  these  is  the  project  cost  as 
identified  by  the  "Total  Person  Days  Expended  to  Date"  line.   It  represents  the  cost  of  the 


23 


project,  in  Person  Days,  at  the  end  of  the  current  interval.  Upon  project  completion,  it 
represents  total  project  cost.  Project  completion  is  normally  indicated  when  the  "% 
Development  Reported  Complete"  is  100  percent.  However,  an  97  percent  completion 
level,  accompanied  by  a  elapsed  time  interval  that  is  not  a  40  day  multiple,  also  indicated 
completion.  To  ensure  all  participants  completed  the  project,  lab  attendants  verified  that 
each  participant  getting  a  completion  indictor  completed  one  more  interval  with  absolutely 
no  changes  made.  They  then  compared  the  two  intervals  and  if  the  exact  same  results 
were  experienced  the  participant  could  log  off. 

The  second  dependent  variable  measured  was  the  project's  completion  time.  This 
variable  was  reflected  in  the  line  "New  Est  of  Project  Duration  (start-end)"  This  line 
reflects  the  estimated  completion  date  at  the  end  of  each  40  day  interval.  The  DYNAMO 
simulation  determines  this  variable  on  the  basis  of  the  status  of  the  project  at  a  specific 
moment  in  time.  It  reflects  the  projected  completion  date  as  calculated  by  the  current 
input. 

The  third  and  final  dependent  variable  was  the  actual  staffing  level  input  by  the 
participants.  Though  this  variable  was  captured  to  the  INFO  file,  participants  were 
requested  to  annotate  written  documentation  sheets  to  provide  a  back  up  if  necessary 
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IV.     EXPERIMENTAL  RESULTS  AND  ANALYSIS 

A.         MODEL  OF  ANALYSIS 

The  raw  data  produced  by  this  single  project  experiment  was  input  to  a  file  called 

INFO  (figure  2-4)  which  contained,  the  final  project  cost,  final  completion  time, 
chronological  staffing  decisions  and  other  necessary  information  for  each  participant    Our 

analysis  focused  on  three  dependent  variables: 

1 )  Participant  performance  concerning  staffing  decisions 

2)  The  absolute  value  of  deviation  by  the  participant  from  an  established 
optimum 

3)  The  absolute  value  of  the  percentage  deviation  each  subject  incurred 
from  the  optimum 

Analysis  of  this  data  was  conducted  using  the  Statistical  Analysis  System  (SAS). 
Specifically,  the  General  Linear  Model  (GLM)  procedure  was  used  for  multivariate 
analyses  due  to  the  unequal  populations  within  the  project  groups.  Appendix  L  illustrates 
the  SAS  control  file  from  the  demographic  analysis,  and  appendix  M  shows  the  SAS 
control  file  used  for  the  GLM  and  Repeated  Measures  analysis.  This  last  file  calculated 
two  new  variables,  Doptimal  and  Poptimal.  Doptimal  represents  the  absolute  deviation  of 
the  input  staff  levels  for  each  subject  in  each  interval  in  comparison  to  the  optimal  project 
staff  level  for  that  interval.  Poptimal  depicts  the  percentage  deviation  from  the  optimal 
staff  level  solution  for  each  subject  per  interval.  The  following  equations  illustrate  how 
these  two  variables  are  calculated: 
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DOPTIMALt  =  Absolute  value  of  (Subject  Staffing  Decision  -  Optimal  Staffing  Decision^ 

POPTIMALt  =  Absolute  value  of  (Subject  Staffing  Decision  -  Optimal  Staffing  Decision^) 

Optunal  Staffing  Decision 

t=  tune  interval 
B.  RESULTS 

1.  Staffing  Level  Decisions 

For  each  of  the  four  groups,  the  mean  staffing  level  was  determined  and  plotted 
against  the  project  time  periods.  This  is  shown  in  figure  4-1 . 


STAFFING  LEVEL  DECISIONS 
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Figure  4-1  Staffing  Level  Decisions  for  each  group 

A  significant  number  of  participants  completed  the  project  before  the  seventh 
period  (Time=240).  In  order  to  minimize  the  problem  of  missing  values,  only  the  first  six 
periods  were  evaluated.  The  figure  illustrates  that  all  four  groups  initially  increased  staff 
size  responding  to  group  specific  information. 
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The  assimilation  and  hiring  group  initially  increased  its  staff  size  at  the  40  day  mark 
in  response  to  the  realization  that  the  delays  would  have  significant  impact  on  the  project 
At  day  120,  the  assimilation  and  hiring  group  reduced  staff  size,  but  then  increased  back  to 
the  previous  level  at  day  160  and  beyond 

The  assimilation-only  group  increased  staff  size  at  the  40  and  80  day  points  as  they 
responded  to  the  realization  that  assimilation  delays  would  cause  the  project  to  fall  behind 
schedule  if  not  compensated  for  at  the  beginning  of  the  project.  As  the  project  progressed 
and  the  staff  became  more  fully  assimilated,  the  participants  began  to  stabilize  the  staff  size 
trying  to  meet  reported  cost  and  schedule  projections.  Near  the  end  of  the  projects 
lifecycle,  they  realized  that  these  projections  were  not  fully  being  met  and  hired  more 
people.  In  accordance  with  'Brook's  Law'  [Ref  1],  this  decreased  the  likelihood  of  a 
successful  completion  as  adding  people  to  a  late  project  makes  it  later. 

The  hiring-only  group  initially  hired  staff  and  then  remained  steady  responding  to 
the  project  requirements  with  slight  deviations  of  the  staff  levels  This  indicates  that  the 
participants  felt  they  had  overcome  the  hiring  delays  early  on  and  could  maintain  current 
staff  levels  However,  near  the  end  of  the  project,  they  began  reducing  staff  to  meet  cost 
and  completion  schedules. 

The  no-delay  group  responded  in  a  similar  fashion  to  the  hiring-only  group  They 
hired  staff  up  front,  and  maintained  a  steady  level  reacting  to  the  immediate  affects  their 
input  had  on  the  project  reports. 


27 


In  conjunction  with  figure  4- 1 ,  Table  4- 1  illustrates  the  repeated  measure  analysis 
of  the  overall  staffing  level  decisions.  The  Within  Subjects  results  show  a  significant 
Period  effect     (P  <  0.05),  indicating  that  the  individual  participants  made  different 
decisions  as  time  progressed.  However,  the    interaction,  or  PROJECT*PERIOD  effect 
Table  4-1    REPEATED  MEASURE  ANALYSIS  OF  STAFFING  LEVEL  DECISIONS 


Source  of 

Degrees  of 

Significance 

variation 

SS 

Freedom 

F 

of  F 

Between  Subjects 

Project 

11.01 

3 

0.41 

0.7478 

Subjects- within 

-Projects 

422.71 

47 

Within  Subjects 

Period 

0.561 

5,43 

6.72 

0.0001 

Project*Period 

0.724 

15,119 

0.98 

0.4755 

is  not  significant  (P  >  0.05),  indicating  that  the  pattern  of  the  decisions  made  was  similar 
over  time  across  the  four  groups  There  was  no  significant  difference  Between  Subjects, 
that  is,  the  overall  decisions  of  the  subjects  were  not  significantly  different  across  the  four 
groups  (P>  0.1). 

2.  Deviation  of  staff  levels  from  optimum  (DOPTEMAL) 

Figure  4-2  illustrates  the  mean  deviation  of  input  staff  levels  from  the  optimum  for 
each  of  the  four  project  groups.  As  shown  in  this  figure,  assimilation  and  hiring  group's 
staff  level  decisions  deviated  significantly  from  the  optimal  at  day  80  of  the  projects 
lifecycle  and  continued  to  deviate  for  the  remainder  of  the  project  This  is  due  to  the 
difficulty  each  participant  encountered  handling  both  the  assimilation  and  hiring  delays. 
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DEVIATION  FROM  OPTIMAL  LEVELS 

(By  Group) 
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Figure  4-2  Deviation  from  optimal  staff  levels  for  each  project  (Absolute  Value) 
The  assimilation-only  group   drastically  deviated  from  the  optimum  at  the  120  day  mark 
This  drastic  deviation  was  due  to  the  participants  inaccurate  attempt  to  overcome  the  high 
assimilation  delay  inherent  to  their  project.  This  group  then  abruptly  shifted  back  towards 
the  optimum  at  day  200.    The  hiring-only  group  differed  from  the  assimilation  and  hiring 
group  and  the  assimilation  only  group  in  that  it  followed   the  optimal  path  more  closely 
As  depicted  earlier  in  figure  4-1  analysis,  this  is  due  to  the  more  accurate  attempt  to 
counter  the  extreme  hiring  delays  encountered.    The  no-delay  group  with  minimal  delays 
remained  fairly  steady  along  the  optimal  path  as  well    This  is  due  to  the  simulation  output 
giving  immediate  results  the  participants  allowing  them  to  modify  the  staff  level  more 
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accurately  There  was  a  tendency  at  the  end  of  the  project  to  hire  additional  people  to 
meet  schedule  and  cost  projections  This  is  common  to  most  development  projects  Table 
4-2  shows  the  repeated  measures   analysis  of  the  overall  deviation  of  staffing  levels  from 

their  optimum  solutions 

Table  4-2  SUMMARY  OF  OPTIMAL  SOLUTION  DEVIATIONS  REPEATED 
MEASURE  ANALYSIS 


Source  of 

Degrees  of 

Significance 

variation 

SS 

Freedom 

F 

of  F 

Between  Subjects 

Project 

917.96 

3 

3.03 

0.0383 

Subjects- within 

-Cells 

4738.63 

47 

Within  Subjects 

Period 

0.80 

5,43 

2.08 

0.0864 

Project*Period 

0.784 

15,119 

0.72 

0.7522 

The  Within  Subjects  results  indicate  no  significant  Period  effect  (P  >  0 .05),  indicating  that 
the  individual  subjects  made  similar  decisions  as  time  progressed.    Furthermore,    the 
interaction  or    PROJECT* PERIOD    effect,  is  not  significant  (P  >  0.05),  indicating  that 
the  pattern  of  the  decisions  made  was  similar  over  time  between  the  four  groups.    There 
was  significance  Between  Subjects  with  overall  decisions     of    the     subjects    being 
significantly  different  across  the  four  groups  (P  <  0.05). 

3.  Percentage  deviation  of  staffing  level  from  Optimal  (POPTIMAL) 
Figure  4-3  illustrates  the  percentage  deviation  of  staff  levels  from  the  optimal  for 
each  group. 
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Figure  4-3  Percentage  deviations  between  optimal  and  actual  staff  levels 
This  figure  indicates  that  the  Assimilation-only,  Hiring-only,  and  No-delay  groups  varied 
similarly,  percentage-wise,  from  the  optimal  solutions.  All  three  deviated  more  in  the 
beginning  then  subsided  toward  the  optimal.  Only  the  assimilation  and  hiring  delay 
group,  varied  severely  throughout  the  project.  This  is  due  to  the  dynamic  requirements  the 
participants  had  of  keeping  track  of  the  delays  and  their  impacts  on  the  project 
Participants  in  assimilation  and  hiring  group  had  to  battle  significant  delays  displayed  to 
them  via  the  project  reports  and  had  great  difficulty  foreseeing  the  next  intervals 
interaction.      The  participants  were  unable  to  correctly  isolate  the  optimal  solution  for 
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their  projects      This  is  due  to  the  burden  managers  face  when  juggling  unpredictable 
information. 

Supporting  figure  4-3,  Table  4-3  illustrates  the  repeated  measures  analysis  for  the 

overall  percentage  deviation  from  the  established  optimal  decision  The   Within     Subjects 

results  indicate  a  non-significant  Period  effect  (P  >  0.05),  indicating  that  the  individual 

subjects  made  similar  decisions  as  time  progressed 

Table  4-3  REPEATED  MEASURE  ANALYSIS  OF  PERCENTAGE  DEVIATION 
FROM  OPTIMAL 


Source  of 

Degrees  of 

Significance 

variation 

SS 

Freedom 

F 

of  F 

Between  Subjects 

Project 

7.02 

3 

8.87 

0.0001 

Subjects- within 

-Cells 

12.41 

47 

Within  Subjects 

Period 

0.869 

5,43 

1.29 

0.2856 

Project*Period 

0.766 

15,119 

0.80 

0.6721 

Furthermore,  the  interaction  or  PROJECT* PERIOD  effect,  is  not  significant  (P 
>  0.05),  indicating  that  the  pattern  of  the  decisions  made  was  similar  over  time  between 
the  four  groups  These  results  indicate  that  the  overall  percentage  deviation  concerning 
staffing  decisions  was  not  significant  across  time  (P  >  0.05).  However,  a  high  Between 
Subjects  effect  indicates  that  the  overall  decisions  of  the  subjects  were  different  across  the 
four  groups  (P  <  0. 1). 
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V.    CONCLUSIONS 

A.  FINDINGS  AND  IMPLICATIONS 

The  objective  of  this  thesis  was  to  conduct  an  experiment  focused  on  gaining 

insight  into  the  implications  assimilation  and  hiring  delays  have  on  a  single  software 
project  management  environment. 

This  information  is  critical  in  that  the  Department  of  Defense,  as  well  as  other 
Federal  agencies,  are  fighting  a  continuous  battle  against  project  cost  and  schedule 
overruns  and  need  to  find  ways  to  remedy  the  situation.  Delays  heavily  impact  staffing 
decisions  throughout  the  project's  life  cycle  and  therefore  require  in-depth  understanding 
This  thesis  provides  empirical  findings  regarding  the  project  managers  behavior  when 
handling  these  delays. 

The  experimental  results  confirm  that  excessive  delays  seriously  affect  the  way  a 
manager  thinks  and  reacts  concerning  staffing  decisions.  Managers  faced  with  significant 
assimilation  and  hiring  delays  often  failed  to  handle  them  properly  thereby  creating  adverse 
affects  to  the  project.  The  overall  findings  of  this  research  indicate  that  managers  make 
better  staffing  level  decisions  when  handling  single  delays  then  managers  dealing  with 
projects  incurring  multiple  delays  with  significant  delay  periods. 

B.  FURTHER  RESEARCH 

There  are  several  areas  that  can  be  potentially  researched  using  the  SDM  model. 
One  area  to  be  researched  could  be  to  see  if  a  team  of  managers  could  better  foresee  and 
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handle  these  associated  delays.  This  could  be  done  by  replicating  part  of  this  experiment 
using  teams  of  decision  makers  to  see  if  the  data  changes  significantly. 

Another  area  to  be  researched  could  be  determining  what  information  needs  to  be 
provided  to  a  manager,  and  at  what  time  during  the  project  life  cycle,  to  enhance  the 
managers  performance  in  handling  delays. 

Lastly,  perhaps  evaluate  the  effects  of  delays  on  an  multi-project  environment. 
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APPENDIX  A:    DYNEX  PROGRAM  FILE  (PROJ?.DNX) 


if#tm<  1  then 
display  clear 


! ! ! !  Important  Points  to  Remember  ! ! ! ! 


-  You  are  not  allowed  to  discuss  this  exercise  with  anyone 
other  than  a  lab  attendant    Please  refrain  from  discussing 
this  with  members  in  the  other  class  until  they  have  completed 
the  exercise. 

-  The  system  will  show  you  the  size  of  the  initial  core  team  of 
software  developers  (the  full  time  equivalent  number).  It  will 
then  ask  you  for  your  initial  desired  staffing  level.  Next  it 
will  run  through  the  first  simulation  time  period  and  show  you 
the  current  reported  statistics.  Make  your  change  to  the 
desired  full  time  equivalent  staffing  level  on  the  documentation 
sheet  provided  after  reviewing  the  report.  There  is  no  need  to 
turn  in  the  documentation  sheet  after  each  interval. 

A  LAB  ATTENDANT  MUST  VERIFY  YOUR  FINAL  RESULTS! 

-  GOOD  LUCK!     Press  <ENTER>  to  continue 

dendq 

choice  1 

cend  1/1 

display  clear 

THE  INITIAL  CORE  TEAM  OF  SOFTWARE 
DEVELOPERS  HAS  BEEN  SET  AT: 


3.5     Full  time  equivalent  Personnel 

1)  Press  <ENTER>  to  keep  that  same  3.5  full  time  equivalent  staff 

OR 

2)  Enter  your  initial  desired  staffing  level  and  press  <ENTER>. 

[Remember,  you  are  working  in  full  time  equivalent  personnel] 

The  current  staffing  level  = 
dendq 
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dq  WFS1=0.5< 
display  clear 


************************l*************:***:**************l 

!!   IMPORTANT  !! 

Make  sure  that  you  have  written  your  staffing 
level  decision  down  on  the  documentation  sheet 
before  continuing  with  the  simulation. 


This  is  your  final  opportunity  to  check  and 
change  the  staffing  level  for  this  time  period. 

Press  <ENTER>  to  keep  the  displayed  number 
OR 
Change  the  staffing  level  and  then  press  <ENTER>. 


******1|C***********************************************| 


Your  subsystem  selected  staffing  level  = 

dendq 

dq  WFS1=0.5< 

else 

choice  1 
cend  1/1 
display  clear 

*  MAKE  YOUR  CHANGE  TO  THE  DESIRED  STAFFING  LEVEL      * 

*********************************************************** 

a)    Press  <ENTER>  to  keep  the  displayed  staffing  level. 

OR 
b)    Enter  the  new  desired  staffing  level  and  press  <ENTER>. 

[Remember  you  are  working  in  full  time  equivalent  personnel] 

Your  last  desired  staffing  level  was  = 
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dendq 

dq  WFS1=0.5< 

display  clear 


sic******************************************************! 

!!  IMPORTANT  !! 

Make  sure  that  you  have  written  your  staffing 
level  decision  down  on  the  documentation  sheet 
before  continuing  with  the  simulation. 


This  is  your  final  opportunity  to  check  and 
change  the  staffing  level  for  this  time  period. 

Press  <ENTER>  to  keep  the  displayed  number 
OR 
Change  the  staffing  level  and  then  press  <ENTER>. 


Your  subsystem  selected  staffing  level  = 

dendq 

dq  WFS1=0.5< 


end 
display  clear 


Press  <ENTER>  to  run  another  interval  and  see  the  updated  output.  * 

*  * 


dendq 
choice  1 
display  clear 
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****************************************************************** 

*  * 

*  There  will  be  a  long  pause  as  the  system  calculates  your  input!  * 

*  * 
*********************************************************** 

dendq 

report 

time=maxtime, 

Format="5<38<53<",PICTURE="Z,ZZ9V" 

"CURRENT  INTERVAL  STATISTICS:","Elapsed  Time  =",tm;; 

Format="5<" 

"INTITIAL  ESTIMATES:   (These  will  not  change  throughout  the  project)", 

FORMAT="8<52<66<",PICTURE="ZZZ,ZZZV" 

"Project  Size",IPRJSZ, "Tasks"; 

FOPvMAT="8<52<66<",PICTURE="ZZZ,ZZZV" 

"Project  Cost",TOTMDO,"Person-Days"; 

FORMAT="8<,52<,66<",PICTURE="ZZZ,ZZZV" 

"Project  Duration",TDEV,"Days*';; 

Format="5<52<,66<",PICTURE=,,ZZ,ZZZ9VM 

"REPORTED  STATISTICS  at  Time  =  =  =  =  =  =>",tm,"Days", 

FORMAT="8<52<66<",PICTURE="ZZ,ZZZ9V" 

"Updated  Estimate  of  Total  Project  Size",PJBSZ,  "Tasks"; 

FORMAT="8<52<66<",PICTURE="ZZ,ZZZ9V" 

"%  Development  Reported  Complete",PDVRC,"Percent"; 

FORMAT="8<,52<,66<",PICTURE="ZZ,ZZZ9V" 

"Total  Person  Days  Expended  to-date",CUMMD, "Person  Days"; 

FORMAT="8<52<,66<",PICTURE="ZZ,ZZZ9V" 

"New  Est  of  Project  Duration  (start-end)",SCHCDT,"Days"; 

FORMAT="8<52<66<",PICTURE="ZZ,ZZZ9V" 

"Time  Remaining", timerm,"Days"; 

FORMAT="8<,52<,66<",PICTURE="ZZ,ZZZ9V99" 

"Current  Staff  Size",FTEQWF,"People", 

FORMAT="8<52<,66<",PICTURE="ZZ,ZZZ9V" 

"Percent  of  Workforce  that  is  Experienced",FRWFEX*  100,  "Percent";; 

FORMAT="5<" 

"PRESS  <ENTER>  TO  VIEW  THE  GRAPHICALLY  DISPLAYED  VARIABLES' 

cend  1/1 

spec  md_length=#length+40 


APPENDIX  B:    BATCH  CONTROL  FILE  (PROJECT7.BAT) 

echo  off 

CLS 

init  1 

GRAPHICS 

bat  /N  /p  /s 

smlt  PROJA  -go  =  -prs  =  -Is  -ns  -plm  6  -bw 

rep  PROJA  INTRVAL  -outf  INTRVAL  OUT  -t  -bw  >NUL 

rep  PROJA  INTRVAL  -outf  INTRVL.  OUT  -bw  >NUL 

rep  PROJA  -t  -bw  >NUL 

timestmp 

-top     dynex  PROJA  -in  PROJA  STT  -sc  -Is  -plm  6  -bw 
smlt  PROJA  -gm  =  -ns  -plm  6  -bw 
capture 

rep  PROJA  INTRVAL  -outf  INTRVAL. OUT  -t  -bw  >NUL 
rep  PROJA  INTRVAL  -outf  INTRVL. OUT  -bw  >NUL 
rep  PROJA  -bw  >NUL 
call  -topi 
Exit 
goto  -top%A 

-top  1    timestmp 
%A  =  1 
ram 
els 


,j~]   ****  vje\y  PROJA  STATUS  REPORT  ******************** 
rep  PROJA  PROJA  -outf  JUNK. OUT  -t  -sc  -Is  -plm  6  -bw 
INKEY  %0 
bat  /p  /s 
els 
color  \1F 


-4-1  ****  VIEW  GRAPHIC  STAFFING  PLOT  **** 
BAT  CLS 
BAT  COLOR  \1F 
BAT  BEGTYPE 
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****************************************************************** 

\  1 A  GRAPHICALLY  DISPLAYED  VARIABLES  \  1 F 

****************************************************************** 

THE  FOLLOWING  VARIABLES  WILL  BE  PLOTTED 

WFS     STAFF  LEVEL  YOU  REQUESTED 

FTEQWF CURRENT  STAFF  LEVEL 

FRWFEX PERCENT  OF  STAFF  THAT  IS  EXPERIENCED 

CMTRMD  CUMULATIVE  PERSON-DAYS  SPENT  ON 

TRAINING  NEW  STAFF 

\1  A     AFTER  VIEWING  PLOT  PRESS  <ESC>  TO  CONTINUE  \1F 

\1A     PRESS  <ENTER>  TO  VIEW  PLOT    \1F 

END 

BAT  INKEY  %0 

BAT  CLS 

REP  PROJA  PROFXPLA 

BAT  /p  /s 
color  \1F 
ram 
els 
begtype 


+ +  \  i  a  REVIEW  MENU  \  1 F+- 


\  1 F     THIS  MENU  ALLOWS  YOU  TO  REVIEW  THE 

STATUS  REPORT  AND  STAFFING  PLOT  AGAIN 
\1F 


\1D   1  \1F  VIEW  YOUR  SUBSYSTEM  STATUS  REPORT  AND 
PLOT  AGAIN 

\1D  2  \1F  PROCEED  TO  SIMULATE  NEXT  TIME  PERIOD 

+ + 

Choose  an  option:  (DO  NOT  HIT  <ENTER>  AFTER  SELECTION!!!!)  ; 

end 
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■  lstkeyl  inkey  %0  |  if  %0  #  =  1  type  %0; 
if%0  =  keyO lb  return 
goto  -%0~1 

-2ndkeyl  inkey  %1  |  if  %1  #  =  1  type  %1; 
if%l  =keyO lb  return 
if  %1  =  key020  goto  -$%0$1 
if  %1  =  keyOOd  goto  -$%0$1 
if%l  =  key008  goto -topi 
if  %1  =  key  14b  goto  -topi 
goto-%0%11 


-2-1    ****  PROCEED  WITH  NEXT  SIMULATION  ******************** 

BAT  CLS 

BAT  COLOR  \1F 

BAT  BEGTYPE 

*  * 

*  WRITE  YOUR  NEW  DESIRED  STAFFING  LEVEL  ON  THE  * 

*  DOCUMENTATION  SHEET  PROVIDED  * 

*  * 

*  PRESS  <ENTER>  * 

END 

bat  /p  /s  goto  -top 

-%0~1 

-$%0$1 

-%0%1 1  beep  goto  -top 

-on.error- 

if  %R  >  82  if  %R  <  90  type  !!  Floating  Point  Error  !!  |goto  -Calc. 
Cls  beep  type  Unexpected  batch  file  error  %R  in  line  %L  |exit 
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APPENDIX  C:    BATCH  CONTROL  FILE  (TEST.BAT) 

echo  off 

CLS 

init  1 

GRAPHICS 

bat  /N  /p  /s 

smlt  TEST  -go  =  -prs  =  -Is  -ns  -plm  6  -bw 

rep  TEST  INTRVAL  -outf  INTR VAL  OUT  -t  -bw  >NUL 

rep  TEST  INTRVAL  -outf  INTR VL  OUT  -bw  >NUL 

rep  TEST  -t  -bw  >NUL 

timestmp 

-top     dynex  TEST  -in  TEST  STT  -sc  -Is  -plm  6  -bw 
smlt  TEST  -gm  =  -ns  -plm  6  -bw 
capture 

rep  TEST  INTRVAL  -outf  INTRVAL  OUT  -t  -bw  >NUL 
rep  TEST  INTRVAL  -outf  INTR  VL.  OUT  -bw  >NUL 
rep  TEST  -bw  >NUL 
call  -topi 
Exit 
goto  -top%A 

-topi    timestmp 
%A  =  1 
ram 
els 

_ii    ****  VIEW  TEST  STATUS  REPORT  ******************** 
rep  TEST  TEST  -outf  JUNK  OUT  -t  -sc  -Is  -plm  6  -bw 
INKEY  %0 
bat  /p  /s 
els 
color  \1F 


.4^1  ****  VIEW  GRAPHIC  STAFFING  PLOT  **** 
BAT  CLS 
BAT  COLOR  \1F 
BAT  BEGTYPE 
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****************************************************************** 

\1A  GRAPHICALLY  DISPLAYED  VARIABLES  \1F 

****************************************************************** 

THE  FOLLOWING  VARIABLES  WILL  BE  PLOTTED: 

WFS     STAFF  LEVEL  YOU  REQUESTED 

FTEQWF CURRENT  STAFF  LEVEL 

FRWFEX PERCENT  OF  STAFF  TFIAT  IS  EXPERIENCED 

CMTRMD  CUMULATIVE  PERSON-DAYS  SPENT  ON  TRAINING 

NEW  STAFF 

\  1 A      AFTER  VIEWING  PLOT  PRES  S  <ESC>  TO  CONTINUE  \  1 F 

\1A      PRESS  <ENTER>  TO  VIEW  PLOT    \1F 

END 

BAT  INKEY  %0 

BAT  CLS 

REP  TEST  TESTFXPL 

BAT  /p  /s 
color  \1F 
ram 
els 
begtype 

+ + 

+— +  \  1 A  REVIEW  MENU  \  1 F+ + 

\1A  \1F 


\1F  THIS  MENU  ALLOWS  YOU  TO  REVIEW  THE 

STATUS  REPORT  AND  STAFFING  PLOT  AGAIN 

\1F 

\1D  1    \1F  VIEW  YOUR  SUBSYSTEM  STATUS  REPORT  AND 
PLOT  AGAIN 

\1D  2    \1F  PROCEED  TO  SIMULATE  NEXT  TIME  PERIOD 
+- - - — + 

Choose  an  option:  (DO  NOT  HIT  <ENTER>  AFTER  SELECTION! ! ! !)  ; 

end 

-lstkeyl  inkey  %0  |  if  %0  #  =  1  type  %0; 
if%0  =  keyO lb  return 
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goto-%0~l 

-2ndkeyl  inkey  %1  |  if  %1  #  =  1  type  %1; 
if%l  =  keyO lb  return 
if  %1  =  key020  goto  -$%0$1 
if  %1  =  keyOOd  goto  -$%0$1 
if%l  =key008  goto  -topi 
if  %1  =  key  14b  goto  -topi 
goto-%0%11 

-2-1    ****  PROCEED  WITH  NEXT  SIMULATION  ******************** 
BAT  CLS 
BAT  COLOR  \1F 
BAT  BEGTYPE 

*  * 

*  WRITE  YOUR  NEW  DESIRED  STAFFING  LEVEL  ON  THE  * 

*  DOCUMENTATION  SHEET  PROVIDED  * 

*  * 

*  PRESS  <ENTER>  * 

END 

bat  /p  /s  goto  -top 

-%0~1 

-$%0$1 

-%0%  1 1  beep  goto  -top 

-on  error- 

if  %R  >  82  if  %R  <  90  type  !!  Floating  Point  Error  !!  |goto  -Calc. 
Cls  beep  type  Unexpected  batch  file  error  %R  in  line  %L  |exit 
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APPENDIX  D:  EXPERIMENT  PARTICIPATION  GUIDELINES 

********£)Q  not  START  THE  NETWORK!!!********* 
***READ  INSTRUCTIONS  IN  THEIR  ENTIRETY  BEFORE  DOING  ANYTHING!!!*** 

A.  TRIAL  RUN 

This  TRIAL  RUN  portion  (1  thru  15)  of  the  instruction  set  will  take  you  through  both  the 
initial  set  up  and  training  portions  of  the  experiment.  Follow  the  instructions  carefully    If 
any  problems  arise,  immediately  seek  out  the  lab  attendant. 

1).  Insert  the  disk  into  the  appropriate  drive 

2).  From  the  c:\>  prompt  change  to  the  appropriate  drive  (ex:  b:  press  <ENTER>) 

3)  Type  TESTat  the  b:\>  prompt  to  begin  the  trial  run  (exTESTpress  <ENTER>) 

4)  You  are  now  looking  at  the  PERSONAL  IDENTIFICATION  screen.  Enter  your  Last 
name,  press  <ENTER>,  then  enter  your  SMC  number,  press  <ENTER> 

5)  You  are  now  looking  at  the  INTRODUCTORY  SCREEN.  Please  ensure  you  read  it 
carefully  and  follow  the  rules  completely!.  Press  <ENTER> 

6).  You  are  now  looking  at  the  INITIAL  STAFFING  LEVEL  screen.  You  can  keep  the 
number  shown  or  change  the  number  to  any  you  desire.  Press  <ENTER> 

7).  You  are  now  looking  at  the  ENSURE  YOUR  ANSWER  screen.  This  screen  prompts 
you  to  document  your  entry  on  the  document  sheet,  and  allows  you  to  verify  the  answer 
you  have  entered  OR  change  the  answer  if  you  like.  Press  <ENTER> 

8)  This  next  screen  tells  you  that  you  are  about  to  run  the  interval  with  the  staffing  level 
you  have  chosen    There  is  a  moderate  pause.  Press  <ENTER> 

9).  The  system  will  now  generate  the  project  report  for  a  period  of  forty  days.  Review 
this  report  to  become  acquainted  with  the  displayed  information.  Press  <ENTER> 

10)  You  are  now  looking  at  the  GRAPHICALLY  DISPLAYED  VARIABLES  screen. 
This  screen  shows  you  the  variables  that  are  going  to  show  up  on  the  plot.  It  is  important 
that  you  know  these  variables  and  how  they  relate  to  each  other.  These  acronyms  .  their 
meanings  and  their  scale  follow.  Press  <ENTER> 


45 


WFS     STAFF  LEVEL  YOU  REQUESTED  (0  to24) 

FTEQWF CURRENT  STAFF  LEVEL  (0  to  24) 

FRWFEX PERCENT  OF  STAFF  THAT  IS 

EXPERIENCED  (0  to  100) 

CMTRMD CUMULATIVE  PERSON-DAYS  SPENT  ON 

TRAINING  NEW  STAFF  (0  to  150) 

1 1)  You  are  now  looking  at  the  VARIABLES  PLOT.  Take  a  moment  to  review  the 
scale  of  each  variable  (labeled  at  top  of  screen)  and  how  the  colored  lines  vary  over  time 

-  Press  <ESC>  (pressing  anything  other  than  ESC  will  regenerate  the  plot) 

12)  You  are  now  looking  at  the  REVIEW  MENU.  This  menu  allows  you  to  press  (1)  to 
return  to  the  status  report  and  plot  perhaps  for  another  look  OR  to  press  (2)  to  proceed  to 
the  next  interval  (DO  NOT  PRESS  ENTER  AFTER  HITTING  THE  DESIRED 
NUMBER)  Press  (2) 

13)  You  are  now  looking  at  the  PROCEED  THROUGH  NEXT  INTERVAL  SCREEN 
with  a  prompt  for  you  to  document  your  staffing  level.  Press  <ENTER>. 

14)  You  are  now  at  the  CHANGE  STAFFING  LEVEL  screen.  Continue  through  at  least 
two  more  intervals  to  become  comfortable  with  the  experiment. 

15)  After  you  are  familiar  with  the  system,  proceed  until  you  are  looking  at  the  REVIEW 
MENU      PRESS  <ESC>    You  will  see  the  Drive  Prompt  appear 

16)  Proceed  to  section  2. 

2.  TO  RUN  THE  EXPERIMENT: 


1)  Follow  instructions  on  the  screens  as  illustrated  above  in  the  TRIAL  RUN  portion. 
Ensure  that  you  enter  your  staff  decisions  on  the  attached  documentation  sheet  when 
prompted. 

2)  The  experiment  is  complete  when  the  (%  Development  Reported  Complete"  and  % 
Test  Reported  Complete"  both  =  100  OR  the  generated  reports  cease  to  increment  to 
another  40  day  interval  (IN  EITHER  CASE.  CHECK  WITH  THE  LAB 
ASSISTANT  BEFORE  STOPPING) 

3)  Upon  clearance  from  the  lab  attendant,  exit  the  system  by  continuing  to  the  review 
menu  and  pressing  <ESC>  Take  the  disk  from  the  machine  and  place  it  and  all 
documentation,  including  your  scratch  paper,  in  the  folder  provided. 

4)  Type      PROJECTA      to  begin  the  experiment.  GOOD  LUCK!!! 
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APPENDIX  E:       EXPERIMENT  DOCUMENTATION  AND 

INSTRUCTION  SET 
(SET  A) 


YOUR  NAME 
SMC  NO 


INTRODUCTION 

The  exercise  you  are  about  to  undertake  is  similar  in  many  ways  to  the  flight 
simulators  that  pilots  use  to  mimic  flying  an  aircraft  from  takeoff  at  point  A  to  landing  at 
point  B  Instead  of  flying  an  aircraft,  though,  this  simulator  mimics  the  life  of  a  real 
software  project  from  the  start  of  the  design  phase  until  the  end  of  testing.  In  this 
simulation,  you  will  be  more  than  an  observer.  In  fact,  you  will  play  an  important  role  on 
the  project:  that  of  the  project  manager. 

Specifically,  your  role  will  be  to  track  the  project's  progress  by  reviewing  status 
reports  that  will  be  produced  for  you  at  two-month  intervals  (40  working  days)  during  the 
project.  As  the  project  manager,  you  must  then  update  the  project's  staffing  level  based  on 
the  knowledge  you  gain  from  these  reports.  You  can  hire  additional  staff  or  decrease  the 
staffing  level  as  you  deem  necessary  to  complete  the  project. 

PROJECT 

The  project  that  you  will  manage  happens  to  have  been  a  real  project  conducted  in 
a  real  organization  The  particular  organization  is  on  the  leading  edge  in  software 
engineering  technology.  For  the  project,  you  will  be  given  a  project  profile  containing  the 
following  initial  information: 

Estimated  Project  Size  (in  Number  of  Tasks*) 
Estimated  Project  Cost  (in  Number  of  Person  Days) 
Estimated  Duration  (in  Number  of  Work  Days) 
Size  of  the  Initial  Core  Team  (in  People**) 

*    A  task  is  a  software  module  that  is  approximately  50  lines  of  code  in  size. 
**  The  Core  Team  is  the  group  of  software  professionals  that  developed  the  project's 
requirements'  specifications.    (Remember,  you  are  taking  over  at  the  beginning  of  the 
Design  Phase). 
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YOUR  TASK 

Your  objective  in  setting  the  staffing  level  should  be  to  finish  on  schedule  while 
avoiding  a  cost  overrun.  Specifically,  you  should  try  to  : 

a)  complete  the  project  on  schedule. 

b)  at  the  lowest  possible  cost. 

Note:  Finishing  ahead  of  schedule  will  not  gain  you  anything.  In  fact,  it  may  hurt 
you,  since  finishing  ahead  of  schedule  will  probably  mean  hiring  more  staff  than  needed, 
thus  incurring  a  higher  cost  than  required. 

SOME  IMPORTANT  THINGS  TO  CONSIDER  IN  MAKING  YOUR 
ESTIMATES: 

Your  primary  task  is  to  update  the  project's  staffing  level  Every  two-month  (40  working 
days)  reporting  period,  you  will  have  the  option  to  adjust  the  project's  staff  level.  You 
may  find  however,  that  the  actual  staff  level  in  the  status  report  is  somewhat  different  from 
the  staff  level  you  chose.  This  will  be  due  to  things  you  cannot  totally  control  such  as 
delays  in  hiring 

Because  all  personnel  in  the  organization  are  already  assigned  to  other  projects,  any  staff 
additions  you  request  will  be  hired  from  the  outside.  As  a  result,  there  will  be  a  delay  in 
hiring  new  staff  and  in  assimilating  them  into  your  project 

-  The  hiring  delay  will  be  3  months  (i.e.,  60  working-days)  on  average. 

-  The  assimilation  delay  for  a  newly  hired  employee  is  typically  4  months 

(i.e.,  80  working-days)  This  is  the  time  it  typically  takes  to  train  a  new  employee 
in  the  mechanics  of  the  project  and  bring  him/her  up  to  speed.  Because  the  organization 
does  not  have  a  formal  training  program,  the  training  is  done  on  the  job  by  having  one 
of  the  experienced  staff  members  spend  25%  of  his/her  time  "hand-holding"  the  new 
employee  During  this  4  month  training  period,  a  new  employee  is  typically  only  half  as 
productive  as  an  experienced  employee. 
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APPENDIX  F:      EXPERIMENT  DOCUMENTATION  AND 

INSTRUCTION  SET 
(SET  B) 

YOUR  NAME:  

SMC  NO: 


INTRODUCTION 

The  exercise  you  are  about  to  undertake  is  similar  in  many  ways  to  the  flight 
simulators  that  pilots  use  to  mimic  flying  an  aircraft  from  takeoff  at  point  A  to  landing  at 
point  B.  Instead  of  flying  an  aircraft,  though,  this  simulator  mimics  the  life  of  a  real 
software  project  from  the  start  of  the  design  phase  until  the  end  of  testing.  In  this 
simulation,  you  will  be  more  than  an  observer.  In  fact,  you  will  play  an  important  role  on 
the  project:  that  of  the  project  manager. 

Specifically,  your  role  will  be  to  track  the  project's  progress  by  reviewing  status 
reports  that  will  be  produced  for  you  at  two-month  intervals  (40  working  days)  during  the 
project.  As  the  project  manager,  you  must  then  update  the  project's  staffing  level  based  on 
the  knowledge  you  gain  from  these  reports.  You  can  hire  additional  staff  or  decrease  the 
staffing  level  as  you  deem  necessary  to  complete  the  project. 

PROJECT 

The  project  that  you  will  manage  happens  to  have  been  a  real  project  conducted  in 
a  real  organization.  The  particular  organization  is  on  the  leading  edge  in  software 
engineering  technology.  For  the  project,  you  will  be  given  a  project  profile  containing  the 
following  initial  information: 

Estimated  Project  Size  (in  Number  of  Tasks*) 
Estimated  Project  Cost  (in  Number  of  Person  Days) 
Estimated  Duration  (in  Number  of  Work  Days) 
Size  of  the  Initial  Core  Team  (in  People**) 

*    A  task  is  a  software  module  that  is  approximately  50  lines  of  code  in  size. 
**  The  Core  Team  is  the  group  of  software  professionals  that  developed  the  project's 
requirements'  specifications.     (Remember,  you  are  taking  over  at  the  beginning  of  the 
Design  Phase). 
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YOUR  TASK 

Your  objective  in  setting  the  staffing  level  should  be  to  finish  on  schedule  while 
avoiding  a  cost  overrun.  Specifically,  you  should  try  to  : 

a)  complete  the  project  on  schedule. 

b)  at  the  lowest  possible  cost. 

Note:  Finishing  ahead  of  schedule  will  not  gain  you  anything.  In  fact,  it  may  hurt 
you,  since  finishing  ahead  of  schedule  will  probably  mean  hiring  more  staff  than  needed, 
thus  incurring  a  higher  cost  than  required. 

SOME  IMPORTANT  THINGS  TO  CONSIDER  IN  MAKING  YOUR 
ESTIMATES: 

Your  primary  task  is  to  update  the  project's  staffing  level.  Every  two-month  (40  working 
days)  reporting  period,  you  will  have  the  option  to  adjust  the  project's  staff  level.  You 
may  find  however,  that  the  actual  staff  level  in  the  status  report  is  somewhat  different  from 
the  staff  level  you  chose.  This  will  be  due  to  things  you  cannot  totally  control  such  as 
delays  in  hiring. 

Because  all  personnel  in  the  organization  are  already  assigned  to  other  projects,  any  staff 
additions  you  request  will  be  hired  from  the  outside.  As  a  result,  there  will  be  a  delay  in 
hiring  new  staff  into  your  project. 

-  The  hiring  delay  will  be  3  months  (i.e.,  60  working-days)  on  average. 

-  The  new  staff  are  hired  from  a  specific  contractor  with  whom  the  organization 
has  had  a  long-term  relationship.  Because  the  contractor's  personnel  are  very  familiar  with 
your  organization's  projects  and  development  environment,  they  can  be  assimilated  and 
brought  up  to  speed  very  quickly.  The  assimilation  delay  for  a  newly  hired  employee  is 
typically  12  days.  This  is  the  time  it  typically  takes  to  train  the  employee  in  the  mechanics 
of  the  project  and  bring  him/her  up  to  speed.  During  this  12  day  training  period,  the 
employee  is  typically  less  productive  than  an  employee  already  on  the  project.  Because  we 
do  not  have  a  formal  training  program,  the  training  is  done  on  the  job  by  having  one  of  the 
experienced  staff  members  spend  25%  of  his/her  time  "hand-holding"  the  new  employee. 
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APPENDIX  G:        EXPERIMENT  DOCUMENTATION  AND 

INSTRUCTION  SET 
(SET  C) 


YOUR  NAME: 
SMC  NO: 


INTRODUCTION 

The  exercise  you  are  about  to  undertake  is  similar  in  many  ways  to  the  flight 
simulators  that  pilots  use  to  mimic  flying  an  aircraft  from  takeoff  at  point  A  to  landing  at 
point  B.  Instead  of  flying  an  aircraft,  though,  this  simulator  mimics  the  life  of  a  real 
software  project  from  the  start  of  the  design  phase  until  the  end  of  testing.  In  this 
simulation,  you  will  be  more  than  an  observer.  In  fact,  you  will  play  an  important  role  on 
the  project:  that  of  the  project  manager. 

Specifically,  your  role  will  be  to  track  the  project's  progress  by  reviewing  status 
reports  that  will  be  produced  for  you  at  two-month  intervals  (40  working  days)  during  the 
project.  As  the  project  manager,  you  must  then  update  the  project's  staffing  level  based  on 
the  knowledge  you  gain  from  these  reports.  You  can  hire  additional  staff  or  decrease  the 
staffing  level  as  you  deem  necessary  to  complete  the  project. 

PROJECT 

The  project  that  you  will  manage  happens  to  have  been  a  real  project  conducted  in 
a  real  organization.  The  particular  organization  is  on  the  leading  edge  in  software 
engineering  technology.  For  the  project,  you  will  be  given  a  project  profile  containing  the 
following  initial  information: 

Estimated  Project  Size  (in  Number  of  Tasks*) 
Estimated  Project  Cost  (in  Number  of  Person  Days) 
Estimated  Duration  (in  Number  of  Work  Days) 
Size  of  the  Initial  Core  Team  (in  People**) 

*    A  task  is  a  software  module  that  is  approximately  50  lines  of  code  in  size. 
**  The  Core  Team  is  the  group  of  software  professionals  that  developed  the  project's 
requirements'  specifications.     (Remember,  you  are  taking  over  at  the  beginning  of  the 
Design  Phase). 
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YOUR  TASK 

Your  objective  in  setting  the  staffing  level  should  be  to  finish  on  schedule  while 
avoiding  a  cost  overrun.  Specifically,  you  should  try  to  : 

a)  complete  the  project  on  schedule. 

b)  at  the  lowest  possible  cost. 

Note:  Finishing  ahead  of  schedule  will  not  gain  you  anything.  In  fact,  it  may  hurt 
you,  since  finishing  ahead  of  schedule  will  probably  mean  hiring  more  staff  than  needed, 
thus  incurring  a  higher  cost  than  required. 


SOME      IMPORTANT     THINGS     TO     CONSIDER     IN     MAKING     YOUR 
ESTIMATES: 


Your  primary  task  is  to  update  the  project's  staffing  level.  Every  two-month  (40  working 
days)  reporting  period,  you  will  have  the  option  to  adjust  the  project's  staff  level.  You 
may  find  however,  that  the  actual  staff  level  in  the  status  report  is  somewhat  different  from 
the  staff  level  you  chose.  This  will  be  due  to  things  you  cannot  totally  control  such  as 
delays  in  hiring. 

Because  your  project  is  a  high  priority  project,  any  staff  additions  you  request  will  be 
transferred  to  you  from  other  ongoing  projects  within  the  organization  rather  than  hiring 
people  from  the  outside.  This  will  minimize  the  delays  in  transferring  new  people  to  the 
project. 

-  The  transfer  delay  will  be  9  days  on  average. 

-  The  assimilation  delay  for  a  newly  transferred  employee  is  typically  80  days. 
This  is  the  time  it  typically  takes  to  train  the  transferee  in  the  mechanics  of  the  project  and 
bring  him/her  up  to  speed.  Because  we  do  not  have  a  formal  training  program,  the 
training  is  done  on  the  job  by  having  one  of  the  experienced  staff  members  spend  25%  of 
his/her  time  hand-holding"  the  transferee.  During  this  80  day  training  period,  the  transferee 
is  typically  less  productive  than  an  employee  already  on  the  project. 


52 


APPENDIX  H:      EXPERIMENT  DOCUMENTATION  AND 

INSTRUCTION  SET 
(SET  D) 


YOUR  NAME: 
SMC  NO: 


INTRODUCTION 

The  exercise  you  are  about  to  undertake  is  similar  in  many  ways  to  the  flight 
simulators  that  pilots  use  to  mimic  flying  an  aircraft  from  takeoff  at  point  A  to  landing  at 
point  B.  Instead  of  flying  an  aircraft,  though,  this  simulator  mimics  the  life  of  a  real 
software  project  from  the  start  of  the  design  phase  until  the  end  of  testing.  In  this 
simulation,  you  will  be  more  than  an  observer.  In  fact,  you  will  play  an  important  role  on 
the  project:  that  of  the  project  manager. 

Specifically,  your  role  will  be  to  track  the  project's  progress  by  reviewing  status 
reports  that  will  be  produced  for  you  at  two-month  intervals  (40  working  days)  during  the 
project.  As  the  project  manager,  you  must  then  update  the  project's  staffing  level  based  on 
the  knowledge  you  gain  from  these  reports.  You  can  hire  additional  staff  or  decrease  the 
staffing  level  as  you  deem  necessary  to  complete  the  project. 

PROJECT 

The  project  that  you  will  manage  happens  to  have  been  a  real  project  conducted  in 
a  real  organization.  The  particular  organization  is  on  the  leading  edge  in  software 
engineering  technology.  For  the  project,  you  will  be  given  a  project  profile  containing  the 
following  initial  information: 

Estimated  Project  Size  (in  Number  of  Tasks*) 
Estimated  Project  Cost  (in  Number  of  Person  Days) 
Estimated  Duration  (in  Number  of  Work  Days) 
Size  of  the  Initial  Core  Team  (in  People**) 

*    A  task  is  a  software  module  that  is  approximately  50  lines  of  code  in  size. 
**  The  Core  Team  is  the  group  of  software  professionals  that  developed  the  project's 
requirements'  specifications.    (Remember,  you  are  taking  over  at  the  beginning  of  the 
Design  Phase). 
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YOUR  TASK 

Your  objective  in  setting  the  staffing  level  should  be  to  finish  on  schedule  while 
avoiding  a  cost  overrun.  Specifically,  you  should  try  to  : 

a)  complete  the  project  on  schedule. 

b)  at  the  lowest  possible  cost. 

Note:  Finishing  ahead  of  schedule  will  not  gain  you  anything  In  fact,  it  may  hurt 
you,  since  finishing  ahead  of  schedule  will  probably  mean  hiring  more  staff  than  needed, 
thus  incurring  a  higher  cost  than  required. 

SOME  IMPORTANT  THINGS  TO  CONSIDER  IN  MAKING  YOUR 
ESTIMATES: 

Your  primary  task  is  to  update  the  project's  staffing  level.  Every  two-month  (40  working 
days)  reporting  period,  you  will  have  the  option  to  adjust  the  project's  staff  level.  You 
may  find  however,  that  the  actual  staff  level  in  the  status  report  is  somewhat  different  from 
the  staff  level  you  chose.  This  will  be  due  to  things  you  cannot  totally  control  such  as 
delays  in  hiring. 

Because  the  project  is  a  high  priority  project,  any  staff  additions  you  request  will  be 
transferred  to  you  from  other  ongoing  projects  within  the  organization  rather  than  hiring 
people  from  outside.  This  will  minimize  the  delays  in  transferring  and  assimilating  new 
people  to  the  project. 

-  The  transfer  delay  will  be  9  days  on  average. 

-  The  assimilation  delay  for  a  newly  transferred  employee  is  typically  12  days. 
This  is  the  time  it  typically  takes  to  train  the  transferee  in  the  mechanics  of  the  project  and 
bring  him/her  up  to  speed.  During  this  12  day  training  period,  a  transferee  is  typically  less 
productive  than  an  employee  already  on  the  project.  Because  we  do  not  have  a  formal 
training  program,  the  training  is  done  on  the  job  by  having  one  of  the  experienced  staff 
members  spend  25%  of  his/her  time  "hand-holding"  the  transferee. 
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APPENDIX  I:      SAMPLE  RANDOMIZED  POPULATION  WORKSHEET 


IS4300 

SEGMENT  ONE 

A 

B 

C 

D 

E 

F 

Bryant 

4 

0 

Lovelace 

1 

C 

Logan 

40 

1 

Meisch 

2 

B 

Lovelace 

0 

2 

Whitten 

3 

D 

Loveless 

43 

3 

Wiedenhoeft 

4 

A 

McDermitt 

45 

4 

Bryant 

2 

B 

McGaha 

53 

6 

Sweeney 

3 

D 

Meisch 

1 

8 

Tutt 

4 

A 

Neilan 

34 

14 

Walters 

1 

C 

Ott 

24 

16 

Sandjojo 

3 

D 

Quinn 

42 

18 

Shadle 

4 

A 

Russo 

37 

21 

Smith 

1 

C 

Sandjojo 

16 

22 

Tillery 

2 

B 

Shadle 

18 

24 

Ott 

4 

A 

Smith 

21 

26 

Walsh 

1 

C 

Stewart 

39 

29 

Suhadi 

2 

B 

Suhadi 

29 

34 

Neilan 

3 

D 

Sweeney 

6 

35 

Tsongas 

1 

A 

Therriault 

51 

37 

Russo 

2 

B 

Tillery 

22 

39 

Stewart 

3 

D 

Tsongas 

35 

40 

Logan 

4 

A 

Tutt 

8 

41 

Weatherford 

2 

B 

VanNederveen 

44 

42 

Quinn 

3 

D 

Walsh 

26 

43 

Loveless 

4 

A 

Walters 

14 

44 

VanNederveen 

1 

C 

Weatherford 

41 

45 

McDermitt 

3 

D 

Whitten 

2 

51 

Therriault 

4 

A 

Wiedenhoeft 

3 

53 

McGaha 

1 

C 
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SAMPLE  RANDOMIZED  POPULATION  WORKSHEET 


IS4300 

SEGMENT  TWO 

A 

B 

C 

D 

E 

F 

Bennett 

48 

5 

Devries 

2 

B 

Biggs 

15 

7 

Bunn 

4 

A 

Bower 

10 

9 

Dwiggins 

1 

C 

Bunn 

7 

10 

Bower 

2 

B 

Buxton 

47 
20 
25 

11 
12 
13 

Crawford 

3 
1 

2 

D 

Carlson 

Cheatum 

C 

Celia 

Dills 

B 

Cheatum 

12 

15 

Biggs 

3 

D 

Clancy 

27 

17 

Johnson 

4 

A 

Crawford 

11 

19 

Freeman 

2 

B 

Day 

33 

20 

Carlson 

3 

D 

Devries 

5 

25 

Celia 

4 

A 

Dills 

13 

27 

Clancy 

1 

C 

Dwiggins 

9 

28 

Fuller 

3 

D 

Freeman 

19 

30 

Lee 

4 

A 

Fuller 

28 

33 

Day 

1 

C 

Gambrino 

46 

36 

Swett 

2 

B 

Hollowell 

50 

38 

Landau 

4 

A 

Johnson 

17 

46 

Gambrino 

1 

C 

Landau 

38 

47 

Buxton 

2 

B 

Lee 

30 

48 

Bennett 

3 

D 

Sufian 

52 

49 

Swanson 

1 

C 

Swanson 

49 
36 

50 

52 

Hollowell 

2 
3 

B 

Swett 

Sufian 

D 
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APPENDIX  J:  SEATING  CHARTS 
LAB  224  SECTION  ONE 


LOVELACE 

ME1SCH 

WHITTEN 

WTEDENHOFl 

SWEENEY 

BRYANT 

WALTERS 

TVTT 

SANJOJO 

LAB  350 


SHADLE 

SMITH 

TILLERY 

OTT 

WALSH 

•UCDERMITT 

SUHADI 

NIELAN 

THERR1AULT 

RUSSO 

TSONGAS 

STEWART 

VAN 

NEDERVEEN 

LOGAN 

WEAJVERFORD 

MCGAHA 

LOVELESS 

QUINN 

SIT  IN  ASSIGNED  SEATS 

IF  PROBLEMS  ARISE  SEEK  OUT 
LAB  ATTENDANT 
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APPENDIX  J:  SEATING  CHARTS 

LAB  224  section  two 


DEVRJES 

BUNN 

DWlGGINl' 

CRAWFORD 

BOUTR 

DILLS 

HOLLOWELL 

BIGGS 

JOHNSON 

LAB  350 


FREEMA!\ 

CARLSON 

CEUA 

CLANCY 

FILLER 

LEE 

DAY 

SWETT 

LANDAU 

GAMBRINO 

BUXTOl\ 

BENNETT 

SWANSON 

sit  in  assigned  sea  ts 

if  problems  arise  seek  out 
lab  attendant 
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APPENDIX  K:     EXPERIMENT  DECISION  RECORD  SHEET 

Initial  Project  Estimates 

Estimated  Project  Size (397  Tasks*) 

Estimated  Project  Cost (1,1 11  Person  Days) 

Estimated  Duration (320  Working  Days) 

Size  of  the  Initial  Core  Team. ...(3. 5  Full  Time  Equivalent  Personnel**) 

*     A  task  is  a  software  module  that  is  approximately  50  lines  of  code  in  size. 
**  The  Core  Team  is  the  group  of  software  professionals  that  developed  the  project's 
requirements  specifications.  (Remember,  you  are  taking  over  at  the  beginning  of  the 
Design  Phase). 

Please  enter  your  project  staffing  decisions  below:  Your  initial  decision  is  the  initial  staff 
level  provided  by  the  system  or  the  change  you  make  to  that  level. 

STAFFING  (FULL  TIME  EQUIVALENT  PERSONNEL) 

Initial  Decision  :  

Time  Elapsed  -  40  days:  

Time  Elapsed  -  80  days:  

Time  Elapsed  -  120  days:  

Time  Elapsed  -  160  days:  

Time  Elapsed  -  200  days:  

Time  Elapsed  -  240  days:  

Time  Elapsed  -  280  days:  

Time  Elapsed  -  320  days:  

Time  Elapsed  -  360  days:  

Time  Elapsed  -  400  days:  

Time  Elapsed  -  440  days:  

Time  Elapsed  -  480  days:  

Time  Elapsed  -  520  days:  

****WHEN  YOU  ARE  DONE,  CALL  FOR  A  LAB  ATTENDANT    **** 
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APPENDIX  L:  DEMOGRAPHIC  SAS  CONTROL  FILE 

libname  datename  "c:\sas\saswork\"; 
data  demograp.dat; 

infile  "c:\sas\saswork\demofile.txt"; 
input  NUMBER  1-7  NAME  $  19-12  SMC  16-19  PROJ  $  24-27  CURRIC  $  40-42  SEX  $ 
48-50  AGE  $  55-58  WORK  $  62-66  YEARS  $  70-74  COMP  $  79-83  HOURS  $  87-93 
GRADE; 
list, 
proc  print; 

title  'Demographic  profiles' 
proc  means, 

var  GRADE; 

by  proj; 
title  'Statistics  for  individual  project  groups'; 
proc  anova; 

classes  proj; 

model  GRADE=PROJ; 

title  'Grades  ANOVA  for  different  teams' 
run, 
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APPENDIX  M:  SAS  GLM  AND  REPEATED  MEASURES  CONTOL  FILE 

DATA  REPEATED  (KEEP  =  LNAME  PROJECT  PERIOD  STAFF); 

INFILE'TROCl  DAT", 

input  lname  $  project  $  period  $  naive  opthd  optad  optha  wfheed  cummd 

pdvrc  ptktst  pjbsz  cmtkdv  cummd  schcdt  timerm  fteqwf  frwfex 

time  staff; 
if(lname='WEATHERF)  then  delete; 


/*  Description  of  data  fields 

opthd:  Optimal  hiring  delay. 

optad:  optimal  assimilation  delay. 

optha:  optimal  hiring  and  assimilation  delay. 

wfneed:  NASA's  decision. 

cummd:  mandays  expended  to  date. 

pdvrc:  percentage  development  complete. 

pktst:  percentage  testing  complete. 

pjbsz:  perceived  job  size. 

cmtkdev:  cumulative  tasks  developed. 

schcdt:  scheduled  completion  date. 

timerm:  time  remaining. 

fteqwf:  current  workforce  size. 

frwfex:  percentage  workforce  size. 

Project:  A  -  Hiring+ Assimilation  delay. 

B  -  Hiring  delay. 

C  -  Assimilation  delay. 

D  -  No  delay. 
*/ 


if    ((period  NE '0.00') 
and  (period  NE  '40.00') 
and  (period  NE  '80.00') 
and  (period  NE '120.00') 
AND  (PERIOD  NE  '160.00') 
AND  (PERIOD  NE  '200.00')) 

/*  AND  (PERIOD  NE  '240.00'))*/ 

then  delete; 
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/*  THIS  CODE  WAS  FOR  INITIAL  ANALYSIS  PORTION*/ 

IF        (PROJECT  =  'A')  THEN  OPTIMAL=OPTHA, 
ELSE  IF  (PROJECT  =  'B')  THEN  OPTIMAL=OPTHD; 
ELSE  IF  (PROJECT  =  'C)  THEN  OPTIMAL=OPTAD; 
ELSE  IF  (PROJECT  =  'D')  THEN  OPTIMAL-NAIVE; 

IF  (OPTIMAL  <  0)  THEN  OPTIMAL  -  MTN  (FTEQWF,  NAIVE); 

DOPTIMAL  =  ABS(STAFF-OPTIMAL); 
POPTIMAL  =  ABS(STAFF-OPTIMAL)/OPTIMAL; 

DIFNAIVE  =  ABS(STAFF-NAIVE); 
PDFNAIVE  -  ABS(STAFF-NAIVE)/(NAIVE); 


PROC  SORT; 
BY  PROJECT  PERIOD; 


PROC  PRINT,  TITLE  '  MJB  THESIS  STATS 
VAR  LNAME  PROJECT  PERIOD; 


PROC  MEANS;  BY  PROJECT  PERIOD; 
TITLE  '  THESIS  MEANS  LISTING'; 
proc  glm; 

CLASS  PROJECT  PERIOD; 
MODEL  STAFF  NAIVE  OPT  AD  OPTHD  OPTHA 

TIME  =  PROJECT  PERIOD  PROJECT*PERIOD;  TITLE  'GLM  STATS'; 
MODEL  OPTIMAL  DOPTIMAL  POPTIMAL=  PROJECT  PERIOD 
PROJECT*PERIOD, 

/*  THIS  IS  A  SECOND  PORTION  OF  CODE  WORKING  TOWARDS  REPEATED 
MEASURES*/ 

PROC  SORT  DATA=REPEATED  OUT-SORT; 
BY  PROJECT  LNAME  PERIOD; 

PROC  TRANSPOSE  DATA=SORT  OUT=TRANS; 
BY  PROJECT  LNAME, 
ID  PERIOD; 
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PROC  PRINT  DATA=TRANS; 

PROC  GLM  DATA=TRANS; 
CLASS  PROJECT; 
MODEL  _0D00  _40D00  _80D00  _120D00  _160D00  _200D00=PROJECT/NOUNI; 

MEANS  PROJECT/SCHEFFE; 
REPEATED  PERIOD  POLYNOMIAL/SHORT  SUMMARY, 

PROC  MEANS; 
VAR  _0D00  _40D00  _80D00  _120D00  _160D00  _200D00; 
BY  PROJECT; 

run; 


63 


APPENDIX  N:  SAS  DEMOGRAPHIC  FILE 


SMC 

PROJ 

PROJ 

CURRJC 

SEX 

AGE 

WORK 

YEARS 

COMP 

HOURS 

NUMERJC 

NAME 

BOX 

ID 

EXP 

EXP 

SINCE 
GRAD 

FAMJL 

USE 

GRADE 

BENNETT 

1559 

D 

N 

370 

M 

28 

7 

S 

6 

2 

33 

BIGGS 

1401 

D 

N 

370 

M 

39 

21 

8 

5 

10 

27 

BOWER 

1810 

B 

N 

370 

F 

32 

10 

11 

5 

20 

37 

BRYANT 

2798 

B 

N 

370 

M 

35 

13 

7 

6 

25 

27 

BUNN 

2373 

A 

N 

370 

M 

42 

19 

14 

6 

15 

33 

BUXTON 

2910 

B 

Y 

370 

M 

32 

14 

10 

5 

12 

37 

CARLSON 

2962 

D 

N 

370 

M 

32 

14 

10 

5 

14 

30 

CARVER 

2306 

B 

Y 

370 

F 

31 

4 

9 

5 

1 

40 

CELIA 

1557 

A 

N 

370 

M 

27 

5 

5 

9 

25 

40 

CLANCY 

2904 

C 

N 

370 

M 

39 

21 

12 

5 

10 

33 

CONROY 

1286 

C 

N 

370 

M 

33 

14 

13 

7 

16 

37 

CRAWFOR 

2089 

D 

N 

370 

F 

30 

7 

8 

4 

4 

37 

DAY 

1337 

C 

N 

370 

M 

28 

7 

7 

8 

8 

37 

DEVRJES 

1659 

B 

N 

370 

M 

33 

11 

11 

5 

5 

33 

DILLS 

2893 

B 

N 

370 

M 

35 

16 

7 

6 

14 

40 

DWIGGIN 

2434 

C 

N 

370 

M 

37 

19 

7 

4 

10 

33 

FREEMAN 

1020 

B 

N 

370 

M 

33 

16 

8 

6 

6 

27 

FULLER 

1259 

D 

N 

370 

M 

35 

12 

12 

5 

3 

33 

GAMBRIN 

2189 

C 

N 

370 

M 

30 

7 

7 

8 

10 

30 

HOLLOWE 

1191 

C 

Y 

370 

M 

31 

10 

4 

5 

2 

37 

HUBBARD 

1110 

D 

N 

370 

M 

37 

20 

13 

7 

3 

33 

JOHNSON 

2986 

A 

N 

370 

M 

30 

7 

7 

7 

15 

37 

LANDAU 

2271 

A 

Y 

370 

M 

42 

23 

17 

9 

40 

30 

LEE 

2847 

A 

N 

370 

M 

28 

10 

6 

8 

15 

33 

LOGAN 

2432 

A 

Y 

370 

M 

31 

9 

9 

7 

6 

40 

LOVELAC 

1054 

C 

N 

370 

M 

28 

12 

6 

3 

5 

40 

LOVELES 

2911 

A 

N 

370 

M 

30 

7 

7 

6 

2 

37 

MCDERM1 

1313 

D 

Y 

370 

M 

26 

5 

5 

9 

8 

37 

MCGAHA 

1064 

C 

Y 

370 

M 

30 

17 

4 

9 

14 

30 

MEISCH 

1294 

B 

Y 

370 

M 

28 

10 

6 

9 

20 

30 

NEIL  AN 

2628 

D 

Y 

370 

F 

29 

7 

7 

6 

5 

33 

OTT 

2913 

A 

N 

370 

M 

28 

6 

6 

7 

10 

40 

QUINN 

1937 

D 

N 

370 

M 

28 

6 

6 

7 

15 

40 

RUSSELL 

2167 

D 

N 

370 

M 

29 

8 

8 

9 

20 

27 

RUSSO 

2213 

B 

Y 

370 

M 

37 

16 

16 

7 

10 

33 

SANDJOJ 

2111 

D 

N 

370 

M 

41 

17 

17 

9 

30 

27 

SHADLE 

2145 

A 

Y 

370 

M 

44 

23 

23 

7 

10 

40 

SMITH 

2332 

C 

Y 

370 

F 

31 

8 

8 

7 

12 

30 

SPEGELE 

2796 

A 

N 

370 

M 

29 

7 

5 

7 

7 

40 

STEWART 

1409 

D 

Y 

370 

M 

36 

13 

14 

4 

15 

37 

SUHADI 

2087 

B 

Y 

370 

M 

43 

19 

19 

6 

5 

33 

SWANSON  1515 

C 

Y 

370 

M 

33 

11 

11 

6 

5 

40 

SWEENEY 

2905 

D 

N 

370 

M 

31 

9 

9 

8 

10 

40 

SWETT 

1088 

B 

N 

370 

M 

32 

16 

10 

9 

10 

40 

THERRIA 

1099 

A 

Y 

370 

M 

32 

11 

9 

7 

13 

37 

TILLER  Y 

1879 

B 

N 

370 

F 

33 

12 

9 

3 

1 

40 

TSONGAS 

2016 

A 

N 

370 

M 

29 

8 

12 

7 

10 

33 

TUTT 

1443 

A 

N 

370 

M 

27 

5 

5 

6 

12 

30 

VANNED 

1143 

C 

Y 

370 

F 

28 

6 

6 

7 

12 

37 

WALSH 

1377 

C 

Y 

370 

M 

37 

17 

17 

9 

4 

30 

WALTERS 

1551 

C 

Y 

370 

F 

39 

20 

17 

7 

25 

40 

WEATHER 

1553 

B 

N 

370 

M 

37 

18 

5 

8 

13 

33 

WHITTEN 

2765 

D 

N 

370 

M 

30 

8 

8 

5 

8 

37 

WIEDEN 

1623 

A 

N 

370 

M 

34 

17 

10 

1 

1 

40 

64 


APPENDIX    O:     SAS    DATA   FILE 


BENNETT  D 

0  .00 

3  .47 

i  .  47 

3.47 

3.47 

3-47 

0.00 

0  00 

0.00 

396 . 50 

0  oc 

0.00 

320  .00 

320.00 

3.47 

100 .00 

4J6 

50 

BENNETT  D 

40  .00 

3. SO 

3  SO 

3.50 

3.50 

3.50 

139.75 

9  -69 

0  .  00 

402.31 

44  .65 

139.75 

317.50 

277.50 

3.50 

99.93 

701 

7.00 

BENNETT  D 

80.00 

7.10 

7.12 

7.12 

7.13 

7  .  10 

388  .57 

28.69 

0.00 

426 .43 

111 .91 

388 . 57 

189  12 

109. 12 

6  .96 

96.40 

44J 

7  00 

BENNETT  D 

120.00 

7.26 

'  .  29 

7.29 

7.32 

7.26 

668  .25 

47.12 

0  00 

505 .86 

201.21 

668.25 

212 .61 

92.61 

7.00 

99  80 

527 

7  .00 

BENNETT  D 

160 .00 

7.17 

7.20 

7.20 

7.23 

7.17 

948.24 

61  .64 

0.00 

676 .63 

303.16 

948.24 

234  51 

74  51 

7  00 

99.99 

447 

7  00 

BENNETT  D 

200.00 

7.08 

7  10 

7.  10 

7.14 

7.08 

1228.24 

77.55 

0  00 

604.75 

421.03 

1228.24 

243.28 

43  28 

7  .00 

100.00 

906 

5.3C 

BENNETT  D 

240.00 

6.34 

5.35 

5.35 

5.25 

5.  33 

1456  95 

93  .05 

0.00 

609 .91 

578.07 

1456.95 

255.90 

15  90 

5  .33 

100  0  0 

387 

J. 50 

BENNETT  D 

279.00 

14.22 

3.33 

3.33 

3.43 

3.73 

1611 .40 

100  .00 

100.00 

610.00 

609 .93 

1611 . 40 

279.17 

0  .  17 

3.53 

100.00 

166 

3  .60 

BIGGS  D 

0.00 

3.47 

3  47 

3.47 

3.47 

3.47 

0.00 

0.00 

0.00 

396.50 

0  .00 

0.00 

320 .00 

320.00 

3.47 

100 .00 

146 

3.50 

BIGGS  D 

40  .00 

3.50 

3  .50 

3.50 

3  .50 

3.50 

139.76 

9  .69 

0.00 

402.31 

44.65 

139.75 

317.50 

277.60 

3.50 

9  9  9.1 

2B4 

5.50 

BIGGS  D 

80.00 

5  .57 

b.b7 

S.57 

5.  58 

5.57 

341.93 

2S  71 

0.00 

424.79 

101.40 

341 .93 

227.06 

147.06 

5  48 

96  .66 

332 

5.60 

BIGGS  D 

120  00 

J. 67 

b  69 

5.69 

S.70 

5.67 

561 .74 

40.  57 

0.00 

491 . 11 

171  .11 

561  .74 

263 .09 

133.09 

5.50 

99  .  86 

230 

5.50 

BIGGS  D 

160  .00 

6  .63 

5  .64 

S  .64 

5.65 

5  63 

781 .74 

51  .  60 

0.00 

560 . 55 

248 . 11 

781  .74 

282.28 

122.28 

5  50 

99  9Q 

220 

4  ! : 

BIGGS  D 

200 .00 

4.5b 

4.  bb 

4.S5 

4.55 

4.56 

971  57 

61  .76 

0  .00 

596  83 

320.37 

971.57 

326 .08 

126 .08 

4  .52 

100 . 00 

200 

4  60 

BIGGS  D 

240 .00 

4.  50 

4.50 

4  SO 

4  .  50 

4. SO 

1151.73 

72.82 

0  00 

607.90 

397.57 

1151.73 

329  .28 

89.28 

4  50 

100.00 

231 

1  OC 

bigg;  d 

280 .00 

5  .00 

5.00 

5.00 

S.01 

5  00 

1347.28 

85  .  36 

0.00 

609.88 

498  98 

1347.28 

321 .24 

41  24 

4  .99 

99  06 

217 

6.40 

BIGGS  0 

320  0C 

9  89 

4  .  33 

4  .  33 

4  .92 

8  .96 

1559.67 

98  .  16 

63  06 

610 .00 

609  .  58 

1659.67 

321.72 

1  72 

6  40 

99  29 

410 

i    40 

BIGGS  D 

327.00 

342.76 

5  19 

5.19 

5  29 

275.28 

1597.45 

100  .00 

100.00 

610 .00 

609.91 

1597.45 

327.01 

0  01 

6  40 

99  S'1 

162 

'  1: 

BOWER  B 

0.00 

3.47 

3  .47 

3  47 

3  47 

3  47 

0  .00 

0.00 

0.00 

396.60 

0.00 

0  .00 

320.00 

320  00 

3.47 

100 .00 

106 

1  .50 

BOWER  B 

40.00 

3  50 

1  50 

3. SO 

3.51 

3  50 

139.17 

9.65 

0  .00 

402.30 

44.53 

139.17 

317.64 

277 .64 

3  49 

99  .90 

281 

6.00 

BOWER  B 

80  .00 

6  11 

7.16 

6  .21 

7.48 

6  11 

305 . bb 

23  30 

0  .00 

423 .72 

92  .59 

305.55 

219. 48 

139 . 48 

4.71 

9  3  61 

285 

1  .00 

BOWER  B 

120.00 

7  .26 

9.11 

7  .39 

9.89 

7  26 

518.56 

37  63 

0.00 

479 .61 

156.96 

518 . 56 

226.66 

106 . 56 

5  .83 

95  13 

2b0 

9.00 

BOWER  B 

160 .00 

9.36 

20.15 

9.  65 

76  .33 

8  .43 

786.70 

51.52 

0.00 

551 .63 

244. 17 

785 .70 

231 .05 

71  06 

7  38 

9  4  73 

288 

-   00 

BOWER  B 

200.00 

7.11 

8  .  14 

7.12 

4  .  85 

7.05 

1069 . 40 

67  .06 

0.00 

595.35 

352.02 

1069 .40 

265 .89 

65  .89 

7.01 

100  00 

238 

4  0  0 

BOWER  B 

240  00 

4.00 

3  .77 

3  99 

3  .31 

4.00 

12b8 .96 

79  .92 

0.00 

608.46 

437.26 

1258.96 

314 . 49 

74  49 

4. OS 

100  00 

294 

5  00 

BOWER  B 

280 .00 

5  47 

3  75 

5  .97 

3  91 

5.13 

1431 .13 

90  .  41 

0.00 

609.98 

560 .04 

1431 .13 

106 . 56 

26.56 

4.51 

97.4b 

191 

b  0 : 

BOWER  B 

320 .00 

12.78 

5  09 

4  .  16 

5.11 

11  .20 

1627. b9 

99  .16 

73.65 

610.00 

609.74 

1627.59 

321.13 

1.13 

5.24 

96  5j 

22  3 

-  :: 

BOWER  B 

326 . 00 

3  3  41.92 

b  60 

5  .60 

5  .60 

2674.65 

1660 .03 

99  .49 

93  .79 

610.00 

609.90 

1660 .03 

325.96 

0  .00 

5  .60 

92.94 

2C  i 

^ .  oc 

BRYANT  B 

0  .00 

3  .47 

3  .47 

3  47 

3.47 

3  47 

0  .00 

0.00 

0  .00 

396.50 

0.00 

0.00 

320.00 

320.00 

3.47 

100.00 

56 

1  5C 

BRYANT  B 

40.00 

3  .50 

3  50 

3  50 

3.51 

3  .  50 

139.17 

9.65 

0.00 

402. 30 

44.53 

139.17 

317 .64 

277.64 

3  .49 

99  90 

361 

4  20 

BRYANT  B 

80.00 

4.25 

4  42 

4.27 

4  46 

4  25 

286.2b 

22.21 

0  .00 

423 . 49 

88  .  34 

286.25 

284  94 

204.94 

3  .83 

Q7   77 

-o2 

4 

BRYANT  B 

120 . 00 

4  .  32 

4  46 

4  .  34 

4  49 

4.32 

443.7b 

33  21 

0  .00 

470 .97 

137.26 

443.75 

312.27 

192.2^ 

4  02 

98  'F 

-■  ;. 

4  OC 

BRYANT  6 

160.00 

4  09 

4.12 

4.09 

4.  13 

4  09 

603.97 

41.35 

0  .00 

534 .46 

190.69 

603  97 

361  .  2" 

201  27 

4  00 

100.00 

27  5 

4  7C 

BRYANT  B 

200 .00 

4.77 

5  .04 

4.80 

5.11 

4.77 

771 .48 

49.37 

0  00 

679.04 

249 .64 

771 .48 

358  44 

168 . 44 

4  34 

98.07 

..  lb 

7.00 

BRYANT  B 

240 .00 

7.11 

10  78 

7.28 

13  .89 

6  81 

973  64 

60.05 

0.00 

601 . 34 

323 .60 

973 . 64 

323  93 

83.93 

6  64 

94  31 

26  j 

-  ! : 

BRYANT  B 

280 .00 

8  .26 

3  .60 

8  .66 

4  .67 

7  .97 

122b. b7 

75  .46 

0  00 

608 . 71 

423 .69 

1225.57 

321 .68 

41  .68 

6  .84 

95  .  54 

217 

10  .20 

BRYANT  B 

320 .00 

13  .30 

8  .  26 

6. SO 

8  .29 

12.32 

1535.17 

94  65 

19.44 

609. 98 

606 .47 

1635.17 

322 .62 

2.62 

8  .48 

95.14 

354 

10  .20 

BRYANT  B 

329 .00 

2329.83 

8  72 

8.72 

8  .72 

1866 .61 

1612 .53 

100 .00 

100 .00 

610 .00 

609 .96 

1612 . 53 

328 .91 

0  .00 

8  .72 

95  .85 

209 

10  20 

BUNN  A 

0.00 

3  47 

3.47 

3-47 

3.47 

3  47 

0  .00 

0  00 

0  .00 

396 .50 

0.00 

0  00 

320.00 

320.00 

3.47 

100 .00 

338 

5  00 

BUNN  A 

40.00 

5  02 

5  39 

5.39 

6  .  39 

4.97 

155.25 

10.59 

0.00 

402.36 

45  .66 

15S.2S 

230  32 

190.32 

4.22 

86  43 

470 

6  00 

BLINN  A 

80.00 

5.06 

5.33 

5.33 

6  .  36 

4  .  97 

332.34 

25.61 

0  00 

424.21 

92.05 

332.34 

243.18 

163  .  18 

4  60 

86.  10 

516 

4.60 

BUNN  A 

120 .00 

4-61 

4.67 

4  .67 

4  90 

4.59 

S13.31 

38.  37 

0.00 

476  06 

143 .40 

S13 .31 

286 .02 

166 .02 

4  .  60 

92.88 

315 

4  50 

BUNN  A 

160  00 

4.60 

4  66 

4  66 

4.91 

4.57 

693 .33 

47.74 

0.00 

540  40 

200.52 

693 .ii 

317.51 

157.51 

4  .50 

95.71 

252 

4  70 

BUNN  A 

200  00 

4.77 

4  .91 

4  .91 

6  .  49 

4.73 

875  47 

57.04 

0.00 

583.43 

264.07 

875.47 

331  69 

131 .69 

4  .60 

95.83 

252 

6  00 

BUNN  A 

240 .00 

6  .06 

9  .03 

9.03 

3  .96 

5.87 

1074 . 40 

68.34 

0  .00 

603 . 36 

338.02 

1074  40 

315.65 

75  .65 

5.28 

87  .86 

381 

6  .  50 

BUNN  A 

280 .00 

6  .60 

4  .  84 

4  .84 

S.S7 

6  42 

1298  .73 

82.78 

0  00 

609.13 

437  .60 

1298.73 

315.47 

35.47 

5  .88 

85.63 

255 

6  .  60 

BUNN  A 

320.00 

6.56 

6  .07 

6  .07 

6  .  13 

6  49 

1540 . 46 

93.06 

5.58 

610 .00 

599  78 

1540 . 46 

333 .48 

13.48 

6  .  18 

87  9b 

142 

6  60 

BUXTON  B 

0  .00 

3  47 

3  47 

3.47 

3.47 

3.47 

0.00 

0  00 

0.00 

396. SO 

0.00 

0  00 

320 .00 

320.00 

3.47 

100 .00 

366 

7  00 

BUXTON  B 

40  00 

7  08 

8  65 

7  .22 

9  14 

7  08 

176.69 

11  .85 

0  .00 

402 .72 

52.28 

176.69 

172.12 

132  12 

5.19 

91  .87 

157 

9.00 

BUXTON  B 

80  .00 

9.  31 

15.64 

9  .  59 

21  .83 

8.74 

425 .23 

31  .52 

0.00 

432 .94 

123.00 

425 .23 

161 .47 

81  .47 

7.05 

93  .  34 

223 

9.00 

BUXTON  B 

120.00 

9.42 

19.87 

9.64 

106.10 

8  .67 

728.16 

50  .03 

0  00 

517 .82 

218.75 

728 .16 

188 . 16 

68  .  15 

8.00 

96.89 

429 

8.00 

BUXTON  B 

160.00 

8.20 

5.82 

8.24 

7.21 

8.05 

1048.17 

67.06 

0.00 

584.51 

337.11 

1048.17 

214. 94 

54  .94 

8.00 

99  90 

162 

8.00 

BUXTON  B 

200.00 

8.12 

7  .93 

8  .22 

7  94 

8.00 

1368.17 

85  .  86 

0.00 

607 .43 

496 .77 

1368.17 

221 .14 

21.14 

8.00 

100  00 

159 

7.00 

BUXTON  B 

230 .00 

81.43 

7.01 

6  78 

7.01 

7.05 

1587  70 

100 .00 

100.00 

609 .99 

609.93 

1587.70 

230.03 

0.0J 

7  05 

100 .00 

190 

7.00 

CARLSON  D 

0  .00 

3.47 

3  47 

3.47 

3.47 

3.4'' 

0  00 

0.00 

0.00 

396.50 

0  00 

0  .00 

320.00 

320.00 

3  .  47 

100  00 

92 

3.60 

CARLSON  D 

40  .00 

3  .50 

3  .  50 

3  .  50 

3  SO 

3  .  50 

139.75 

9  .69 

0.00 

402  31 

44  .65 

139  75 

317  50 

277.50 

3  .  50 

99  93 

213 

3  .50 

CARLSON  D 

80  .00 

3  53 

3. S3 

3.53 

3.54 

3.53 

279.74 

21  .86 

0  .00 

423 . 48 

86  .97 

279 .74 

328 . 38 

2  4  8.38 

3  .  50 

100.00 

322 

4  .50 

CARLSON  D 

120.00 

4  .61 

4  .61 

4.61 

4.62 

4  .61 

4S0.84 

33  .49 

0  .00 

469  72 

138. 42 

450  84 

298 .26 

178 .26 

4  .49 

97.9c 

229 

4  50 

CARLSON  D 

160 . 00 

4  .60 

4  .61 

4  .61 

4  61 

4  .60 

630 .74 

42  .96 

0  .00 

535.59 

198 . 41 

630.74 

332.98 

172.98 

4  50 

99  9 1 

251 

5  00 

CARLSON  D 

200 .00 

b  .007 

5.008 

5  .008 

5.008 

S.007 

826.29 

52  55 

0  .00 

581 .73 

267. 66 

826 . 29 

338 .73 

138 .73 

4  99 

99 .008 

180 

5  00 

CARLSON  P 

240.00 

b-001 

5.001 

5.001 

S.001 

S.001 

1026 .24 

63.73 

0.00 

603.25 

346.  14 

1026.24 

348 . 36 

108 . 36 

6  00 

99  96 

237 

5.00 

CARLSON  0 

280.00 

b.00 

5.00 

5.00 

5.00 

5  00 

1226 .24 

76.59 

0.00 

609  19 

433 .004 

1226.24 

348 .66 

68  56 

5.00 

100  00 

277 

5  00 

CARLSON  D 

320 .00 

b.00 

5  .00 

5  .00 

5  .00 

S  .00 

1426 .24 

89  .60 

0  .00 

609  .98 

548.25 

1426 .24 

348 .56 

28.56 

5.00 

100 .00 

197 

5  00 

CARLSON  D 

356 .00 

171b .82 

5  00 

5  .00 

5.00 

1373  .66 

1606.24 

100.00 

100.00 

610.00 

609.92 

1606.24 

355.97 

0  00 

5.00 

100.00 

221 

6.00 

CARVER  B 

0  00 

3.47 

3.47 

3  .47 

3  47 

3  .47 

0  .00 

0  .00 

0  00 

396 .60 

0.00 

0  .00 

320.00 

320 .00 

3  47 

100.00 

174 

4  50 

CARVER  B 

40.00 

4.bl 

4.72 

4  .  54 

4.77 

4  51 

149 .89 

10  .28 

0.00 

402 . 42 

46.72 

149.89 

252.96 

212 .96 

3  .97 

96  90 

411 

6  00 

CARVER  B 

80  00 

6  11 

7.01 

6.19 

7  29 

6  .  11 

330.  SS 

25  16 

0  .00 

425.33 

99.34 

330. SS 

216 . 33 

136 . 33 

4  96 

9b. 03 

369 

6  00 

CARVER  b 

120.00 

6.20 

6  .88 

6  .26 

7.11 

6  20 

540 .17 

39  .01 

0  .00 

487 .81 

164.52 

640.17 

244.65 

124.66 

5  47 

97  58 

405 

5.00 

CARVER  B 

160  00 

b  .11 

5  .  19 

5.12 

5.21 

S.ll 

744.77 

49.43 

0.00 

556.30 

235 .06 

744.77 

301.24 

141 .24 

6  01 

100.00 

439 

4.86 

CARVER  B 

200.00 

4.90 

4.95 

4.91 

4  97 

4.90 

940  32 

59.45 

0.00 

594.24 

309.00 

940. 32 

323.71 

123.71 

4  86 

100 .00 

519 

5  .85 

CARVER  B 

240  00 

b  .89 

9  .  00 

5.97 

29.57 

S.73 

1145.11 

71  .56 

0  00 

607  .26 

393 .01 

1145-11 

310  60 

70  .60 

6.  34 

97  76 

298 

5  85 

CARVER  B 

280.00 

b  .89 

5.21 

6.00 

5.30 

5.81 

1364.15 

85  .68 

0  00 

609  84 

504.  34 

1364-15 

313  39 

33  .  39 

6  59 

98  .83 

340 

5  .70 

CARVER  b 

320 .00 

13.21 

5. 58 

5.22 

5  59 

11  .60 

1588 .88 

98  .68 

87  02 

610 .00 

609  88 

1588  98 

320 .48 

0  48 

5  64 

99  ,72 

234 

6  70 

CEL1A  A 

0.00 

3  -47 

3.47 

3  .47 

3  47 

3.47 

0.00 

0  00 

0  .00 

396 . 50 

0  .00 

0  .00 

320  .00 

320.00 

3  .47 

100.00 

lid 

6  .00 

:el;a  a 

40.00 

b.02 

5  39 

5.39 

6  .  39 

4  97 

165 .25 

10.59 

0  .00 

402 .36 

45  .66 

1SS  25 

230  32 

190  .  32 

4  22 

86  .43 

352 

6  00 

CELIA  A 

no  oo 

b  .06 

S  .  33 

5  .  33 

6  36 

4  .97 

332  -  34 

25  61 

0  00 

424 .21 

92  .05 

332  34 

243  18 

163.18 

4  60 

86  .  10 

297 

4.60 

CELIA  A 

120.00 

4.71 

4  78 

4  78 

5.04 

4.69 

516 .31 

38.  64 

0.00 

476 . 13 

143 .70 

516  3  1 

281 .75 

161  -", 

4-60 

91  b7 

204 

4  I  0 

CELIA  A 

160 .00 

4.70 

4.76 

4.76 

5.07 

4.67 

700 . 30 

48  .19 

0  .00 

540  67 

201 .48 

700 . 30 

312  48 

152  48 

4  60 
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